-- Logs begin at Wed 2022-11-02 02:54:16 UTC, end at Wed 2022-11-02 03:54:22 UTC. -- Nov 02 03:20:07.590183 dv-cinder-860209-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Nov 02 03:20:07.599859 dv-cinder-860209-6-smb devstack@keystone.service[81385]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 03:20:07 2022] *** Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: nodename: dv-cinder-860209-6-smb Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: machine: x86_64 Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: clock source: unix Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: pcre jit disabled Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: detected number of CPU cores: 4 Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: current working directory: / Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: detected binary path: /usr/bin/uwsgi-core Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: your processes number limit is 47680 Nov 02 03:20:07.601883 dv-cinder-860209-6-smb devstack@keystone.service[81385]: your memory page size is 4096 bytes Nov 02 03:20:07.602549 dv-cinder-860209-6-smb devstack@keystone.service[81385]: detected max file descriptor number: 2048 Nov 02 03:20:07.602549 dv-cinder-860209-6-smb devstack@keystone.service[81385]: lock engine: pthread robust mutexes Nov 02 03:20:07.602549 dv-cinder-860209-6-smb devstack@keystone.service[81385]: thunder lock: enabled Nov 02 03:20:07.602549 dv-cinder-860209-6-smb devstack@keystone.service[81385]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 02 03:20:07.602549 dv-cinder-860209-6-smb devstack@keystone.service[81385]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 03:20:07.641457 dv-cinder-860209-6-smb devstack@keystone.service[81385]: Python main interpreter initialized at 0x5572b6a779c0 Nov 02 03:20:07.641457 dv-cinder-860209-6-smb devstack@keystone.service[81385]: python threads support enabled Nov 02 03:20:07.641457 dv-cinder-860209-6-smb devstack@keystone.service[81385]: your server socket listen backlog is limited to 100 connections Nov 02 03:20:07.641457 dv-cinder-860209-6-smb devstack@keystone.service[81385]: your mercy for graceful operations on workers is 90 seconds Nov 02 03:20:07.641801 dv-cinder-860209-6-smb devstack@keystone.service[81385]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 03:20:07.641892 dv-cinder-860209-6-smb devstack@keystone.service[81385]: *** Operational MODE: preforking *** Nov 02 03:20:07.642116 dv-cinder-860209-6-smb devstack@keystone.service[81385]: *** uWSGI is running in multiple interpreter mode *** Nov 02 03:20:07.642116 dv-cinder-860209-6-smb devstack@keystone.service[81385]: spawned uWSGI master process (pid: 81385) Nov 02 03:20:07.642308 dv-cinder-860209-6-smb systemd[1]: Started Devstack devstack@keystone.service. Nov 02 03:20:07.648486 dv-cinder-860209-6-smb devstack@keystone.service[81385]: spawned uWSGI worker 1 (pid: 81396, cores: 1) Nov 02 03:20:07.648486 dv-cinder-860209-6-smb devstack@keystone.service[81385]: spawned uWSGI worker 2 (pid: 81397, cores: 1) Nov 02 03:20:07.648486 dv-cinder-860209-6-smb devstack@keystone.service[81385]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 03:20:11.924296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:20:11.924296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: from cryptography.utils import int_from_bytes Nov 02 03:20:11.925122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:20:11.925122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: from cryptography.utils import int_from_bytes Nov 02 03:20:11.926238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:20:11.926238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: from cryptography.utils import int_from_bytes Nov 02 03:20:11.926697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 03:20:11.926697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: from cryptography.utils import int_from_bytes Nov 02 03:20:11.974282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 03:20:11.974453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 03:20:11.974649 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] command line args: [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 03:20:11.974916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 03:20:11.975094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ================================================================================ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 03:20:11.975346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] admin_token = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.975480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 03:20:11.975592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config_dir = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.975678 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 03:20:11.975779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.975862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] command line args: [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 03:20:11.975960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] config_source = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.976117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 03:20:11.976205 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] debug = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.976282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ================================================================================ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 03:20:11.976351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.976588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] admin_token = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.976717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.976831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_dir = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.976932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.977026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.977125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.977230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_source = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.977330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] debug = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.977435 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.977531 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.977661 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.977762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_config_append = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.977860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.977965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.978064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.978164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_dir = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.978263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.978363 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.978462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.978574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.978696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.978776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.978889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_config_append = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.978962 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_dir = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979261 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979412 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979804 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.979942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.980109 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.980196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.980313 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.980394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.980513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.980603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.980762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.980887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.981000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.981117 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.981236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.981347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.981463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.981583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.981697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.981881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.981995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.982128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.982780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] publish_errors = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.982966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.983089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.983209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.983320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.983441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.983553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.983668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.983784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.983905 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] publish_errors = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.984017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] standard_threads = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.984127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.984258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.984379 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.984379 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.984621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.984621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.984848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.984966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_journal = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.985090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.985203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_json = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.985203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_stderr = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.985424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] standard_threads = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.985537 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] use_syslog = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.985654 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.985823 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.985940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.986052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.986170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.986170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_journal = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.986392 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.986512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_json = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.986631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.986743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_stderr = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.986854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.986966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_syslog = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.986966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 03:20:11.987185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.987185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.987400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.987512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.987628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.987741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.987860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.987974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.988092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.988204 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.988315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.988426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.988571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.988685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.988797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.988913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.989026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.989137 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.989256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.989369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.989480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.989596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.989720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.989841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.989965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.990079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.990189 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.990299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.990409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.990519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.990638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.990749 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.990860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.990970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.991086 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.991199 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.991388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.991502 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.991626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.991744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.992123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.992244 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.992356 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.992489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.992603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.992718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.992829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.992952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.993072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.993184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.993295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.993406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.993516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.993639 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.993750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.993861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.993971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.994081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.994191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.994311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.994423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.994534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.994644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.994760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.994871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.994990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.995102 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.995213 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.995325 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.995435 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.995544 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.995664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.995775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.995886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.996002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.996113 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.996223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.996341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.996454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.996624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.996743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.996855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.996967 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.997157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.997277 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.997395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.997508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.997619 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.997729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.997852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.998610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.998730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.998902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.999044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.999164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.999286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.999398 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.999511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.999629 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.999741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.999853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:11.999973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.000091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.000203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.000313 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.000424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.000592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.000718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.000832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.000949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.001094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.001201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.001304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.001400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.001500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.001596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.001702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.001798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.001893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.001998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.002094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.002207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.002310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.002421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.002541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.002662 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.002790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.002905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.003026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.003140 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.003251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.003364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.003484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.003597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.003710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.003822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.003933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.004053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.004182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.004298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.004410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.004537 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.004650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.004763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.004889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.005004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.005115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.005227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.005345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.005459 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.005579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.005692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.005805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.005923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.005923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.006141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.006263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.006377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.006489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.006607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.006720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.006833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.006953 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.007068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.007177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.007295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.007295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.007507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.007627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.007741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.007853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.007966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.008077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.008189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.008189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.008412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.008538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.008661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.008775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.008887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.009076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.009192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.009304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.009416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.009535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.009658 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.009780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.009902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.010021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.010134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.010247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.010359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.010471 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.010592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.010706 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.010819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.010930 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.011043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.011161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.011282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.011282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.011494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.011607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.011720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.011843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.011965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.external = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.011965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.012178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.012178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.012416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.012597 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.012724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.012724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.password = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.012946 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.013061 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] auth.token = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.013184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.013299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.013421 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.external = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.013550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.013682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.013857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.014003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.014121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.014236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.014350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.014473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.password = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.014588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.014702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.token = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.014815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.014929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.014929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.015151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.015268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.015382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.015497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.015611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.015726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.015852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.015973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.016088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.016201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.016316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.016429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.016573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.016697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.016818 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.016933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.017039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.017152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.017274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.017390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.017503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.017616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.017730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.017844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.017965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.018080 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.018194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.018307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.018422 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.018535 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.018657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.018772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.018876 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.018971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.019083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.019196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.019318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.019434 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.019547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.019659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.019772 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.019886 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.020007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.020122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.020235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.020348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.020484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.020615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.020731 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.020844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.020957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.021090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.021205 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.021329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.021445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.021559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.021672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.021785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.021899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.022024 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.022148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.022262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.022375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.022488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.022608 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.022801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.022918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.023031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.023144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.023144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.023357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.023479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.023599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.023599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.023814 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.023814 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.024025 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.024147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.024261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.024374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.024501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.024617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.024731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.024857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.024972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.025086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.025199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.025386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.025501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.025626 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.025743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.025743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.025964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.026077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.026190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.026311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.026426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.026426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.026639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.026752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.026865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.026987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.027101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.027215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.027327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.027440 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.027553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.027674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.027788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.027892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.028004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.028117 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.028231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.028353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.028524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.028641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.028755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.028869 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.028983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.029128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.029302 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.029422 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.029537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.029650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.029772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.029888 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.030003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.030116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.030229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.030343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.030465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.030580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.030699 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.030814 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.030927 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.031042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.031164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.031164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.031378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.031491 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.031604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.031717 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.031839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.031954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.032069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.032182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.032295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.032409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.032552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.032672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.032785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.032898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.033010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.033124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.033245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.033359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.033472 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.033584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.033696 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.033808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.033914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.034010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.034122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.034235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.034348 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.034460 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.034580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.034695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.034807 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.034921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.035034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.035147 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.035268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.035382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.035495 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.035608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.035720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.035833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.035954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.036068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.036181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.036181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.036392 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.036392 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.036630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.036745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.036858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.036970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.037082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.037195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.037317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.037431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.037543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.037656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.037768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.037880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.038000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.038114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.038226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.038340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.038452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.038571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.038692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.038692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.038878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.038878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.039053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.039149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.039254 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.039353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.039449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.039544 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.039639 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.039735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.039839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.039936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.040032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.040136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.040231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.040326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.040431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.040558 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.040656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.040656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.040831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.040831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.041027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.041027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.041207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.041302 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.041403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.041499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.041609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.041609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.041803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.041905 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.042974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.043149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.043149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.043350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.043350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.044079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.044198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.044313 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.044570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.044691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.045323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.045423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.045536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.045662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.045777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.045891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.045891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.046104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.046218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.046340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.046455 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.046569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.046569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.046783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.046896 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.047018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.047018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.047232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.047345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.047458 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.047571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.047692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.047793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.047888 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.047983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.048078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.048175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.048282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.048381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.048494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.048597 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.048693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.048791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.048901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049487 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049872 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.049976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.050073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.050169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.050264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.050360 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.050455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.050559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.050657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.050752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.050847 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.050943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.051085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.051196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.051294 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.051390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.051493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.051590 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.051685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.051788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.051885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.051885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.052063 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.052158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.052253 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.052357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.052486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.052597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.052699 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.052794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.052898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.052898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.053092 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.053188 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.053296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.053394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.053490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.053594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.053696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.053815 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.053933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.054048 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.054160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.054273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.054386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.054499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.054603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.054714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.054827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.054949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.055064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.055178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.055291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.055412 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.055527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.055642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.055763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.055877 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.055990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.056103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.056217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.056330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.056451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.056597 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.056713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.056837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.056951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.057065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.057178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.057291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.057413 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.057528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.057650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.057764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.057878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.057981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.058102 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.058207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.058320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.058433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.058547 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.058660 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.058782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.058897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.059010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.059124 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.059237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.059352 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.059474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.059590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.059703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.059817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.059929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.060043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.060165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.060280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 03:20:12.061026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.061136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.061321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.061583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.061784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.062022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 03:20:12.062195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 03:20:12.089562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.089789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.090017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.090444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.090682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.090911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.098408 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.099369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.127640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.127866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.129996 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.130233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.180718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.180845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.229238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.229423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.229510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.229663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.382436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.382657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.382881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.383107 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.383325 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.383542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.383625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.383789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.384012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.384230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.384445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.384687 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.407110 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.407298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.407395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.407537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.407640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.407760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.407844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.407981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.408064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.408198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.408282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.408410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.408532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.408653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.419433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.419768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.432300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.432561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.432656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.432748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.432855 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.432939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.433083 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.433165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.433309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.433400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.433519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.433601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.433739 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.433953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 03:20:12.451676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.451820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.452002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 03:20:12.452152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 03:20:12.452339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.452422 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.452547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 03:20:12.452630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 03:20:12.452822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.452904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.453085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.453345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.453425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.453601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.453678 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.453866 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.463121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.463291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.463406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.463576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.463680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.463851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.463964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.464140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.470972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.471130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.473863 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.474097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.474190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.474421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.474546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.474705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.474817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.474993 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.475129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.475258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.475383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.475513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.475657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.475787 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.475919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.476046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.476178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.476317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.476578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.476724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.476896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.477174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.500136 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.500373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.501609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.501865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.501945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.502155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.506497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.506783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.507066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.508562 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.508852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.509138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.513399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.514235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.516163 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.516480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.519911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.520216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.520531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.520638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.520823 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.520935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.521103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.521224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.521377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.521513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.521661 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.521808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.521924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.522078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.522363 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.522643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.537324 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.537602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.538504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.538790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.541428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.542654 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.544640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.545468 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.546538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.546837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.549633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.551061 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.552754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.554217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.555927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.556227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.556533 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.556819 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.557104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.557392 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.557471 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.557738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.558029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.558319 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.558621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.558908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.572999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.573292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.573562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.573826 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.574680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.574973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.575247 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.575517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.581255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.582782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.583178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.584326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.584630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.584746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.586301 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.586583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.587253 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.587547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.587830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.588117 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.588532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.589253 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.589545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.589939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.590239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.590540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.599715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.600015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.600301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.600608 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.601007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.601286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.601568 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.601708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.602005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.602384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.602671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.602970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.603253 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.603535 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.617613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.619655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.620532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.622583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.623466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.624906 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.625624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.626372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.626657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.627057 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.627137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.628689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.628981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.629270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.633398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.634850 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.635598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.637094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.637715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.638113 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.638398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.639283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.640603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.640902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.641194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.641480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.647047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.647340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.647621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.649245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.649540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.649826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.654661 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.654953 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.655234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.655512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.655785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.656058 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.656333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.656671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.656970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.657257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.657528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.657627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 03:20:12.657789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.657919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.658061 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.658205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.658325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.658487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.658760 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.659033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.659321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.659608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.659899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.660209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.660517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.660794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.661064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.661338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 03:20:12.692425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5572b6a779c0 pid: 81396 (default app) Nov 02 03:20:12.694796 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5572b6a779c0 pid: 81397 (default app) Nov 02 03:20:12.695618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9cfc-d58b-4a4e-a35b-5a86bc5deb83 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:12.695906 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9cfc-d58b-4a4e-a35b-5a86bc5deb83 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:12.696182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f9cfc-d58b-4a4e-a35b-5a86bc5deb83 None None] PATH_INFO: `/v3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:12.700281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Wed Nov 2 03:20:12 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:19.529820 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf3c38-3ccf-48c8-81c5-3a4ba426cfe0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:19.530327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf3c38-3ccf-48c8-81c5-3a4ba426cfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:19.530437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf3c38-3ccf-48c8-81c5-3a4ba426cfe0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:19.534643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:20:19.539800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:19.540391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:19.540391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:19.610175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: INFO dbcounter [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] Registered counter for database keystone Nov 02 03:20:19.629688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG oslo_db.sqlalchemy.engines [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:20:19.635809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writer thread running {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:20:19.814291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG passlib.handlers.bcrypt [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81396) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 03:20:19.814590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG passlib.handlers.bcrypt [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81396) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 03:20:19.872999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:19.874611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:20.004177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 03:20:20.297196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf3c38-3ccf-48c8-81c5-3a4ba426cfe0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:20.365763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: INFO dbcounter [None req-cdcf3c38-3ccf-48c8-81c5-3a4ba426cfe0 None None] Registered counter for database keystone Nov 02 03:20:20.387365 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG oslo_db.sqlalchemy.engines [None req-cdcf3c38-3ccf-48c8-81c5-3a4ba426cfe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 03:20:20.394160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writer thread running {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 03:20:20.509918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf3c38-3ccf-48c8-81c5-3a4ba426cfe0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:20.515118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a9afa-3f44-4cfd-b135-c8f9a0db0536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:20.515745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a9afa-3f44-4cfd-b135-c8f9a0db0536 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:20.516027 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a9afa-3f44-4cfd-b135-c8f9a0db0536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:20.516300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a9afa-3f44-4cfd-b135-c8f9a0db0536 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:20.524678 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a9afa-3f44-4cfd-b135-c8f9a0db0536 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:20.576265 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3e2a9afa-3f44-4cfd-b135-c8f9a0db0536 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 03:20:20.576825 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a9afa-3f44-4cfd-b135-c8f9a0db0536 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:20.585887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Nov 2 03:20:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:20:20.592522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:20.609761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ada1c-8245-4ff3-8675-883bec39aed2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:20.614290 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074f8a1-8907-41ed-aaa8-35a043a0e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:20.615394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074f8a1-8907-41ed-aaa8-35a043a0e3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:20.615681 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074f8a1-8907-41ed-aaa8-35a043a0e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:20.615959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074f8a1-8907-41ed-aaa8-35a043a0e3a8 admin admin] PATH_INFO: `/v3/projects/d6472819eb36466497e7080c4f423ed7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:20.617862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074f8a1-8907-41ed-aaa8-35a043a0e3a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6472819eb36466497e7080c4f423ed7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:20.670615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9074f8a1-8907-41ed-aaa8-35a043a0e3a8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 03:20:20.670961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074f8a1-8907-41ed-aaa8-35a043a0e3a8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:20.675414 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Nov 2 03:20:20 2022] GET /identity/v3/projects/d6472819eb36466497e7080c4f423ed7 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:22.789400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe7d17-0ad7-44f2-b209-6387bafdf0fd None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:22.789905 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe7d17-0ad7-44f2-b209-6387bafdf0fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:22.789990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe7d17-0ad7-44f2-b209-6387bafdf0fd None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:22.794026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:22.800090 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b14f0-519c-4ecd-9b04-e7327bb521d7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:22.800533 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b14f0-519c-4ecd-9b04-e7327bb521d7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:22.800671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b14f0-519c-4ecd-9b04-e7327bb521d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:22.820198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cf1b14f0-519c-4ecd-9b04-e7327bb521d7 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:22.821724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cf1b14f0-519c-4ecd-9b04-e7327bb521d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:22.829543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 03:20:23.099496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe7d17-0ad7-44f2-b209-6387bafdf0fd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:23.111576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe7d17-0ad7-44f2-b209-6387bafdf0fd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:23.115775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79f594-e165-4378-b49e-a325855c254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:23.116372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79f594-e165-4378-b49e-a325855c254b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:23.116941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79f594-e165-4378-b49e-a325855c254b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:23.117216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79f594-e165-4378-b49e-a325855c254b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:23.124835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79f594-e165-4378-b49e-a325855c254b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:23.126595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79f594-e165-4378-b49e-a325855c254b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:23.135132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Nov 2 03:20:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 03:20:23.141014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b14f0-519c-4ecd-9b04-e7327bb521d7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:23.149934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b14f0-519c-4ecd-9b04-e7327bb521d7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:23.154256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a2c0b-6064-400f-b8f9-72793058c821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:23.154874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a2c0b-6064-400f-b8f9-72793058c821 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:23.155156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a2c0b-6064-400f-b8f9-72793058c821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:23.155429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a2c0b-6064-400f-b8f9-72793058c821 admin admin] PATH_INFO: `/v3/users/74e842bce75f4436a698ca681099c480` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:23.156762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a2c0b-6064-400f-b8f9-72793058c821 admin admin] RBAC: Authorizing `identity:get_user(user_id=74e842bce75f4436a698ca681099c480)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:23.158559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a2c0b-6064-400f-b8f9-72793058c821 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:23.160043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Wed Nov 2 03:20:23 2022] GET /identity/v3/users/74e842bce75f4436a698ca681099c480 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:25.336519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092097-2777-4328-bd6a-be7f3681b443 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:25.337056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092097-2777-4328-bd6a-be7f3681b443 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:25.337056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092097-2777-4328-bd6a-be7f3681b443 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:25.338313 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:25.343552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075bace-ee44-448d-90af-7bf713f43827 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:25.343984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075bace-ee44-448d-90af-7bf713f43827 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:25.344106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075bace-ee44-448d-90af-7bf713f43827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:25.362285 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7075bace-ee44-448d-90af-7bf713f43827 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:25.363455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7075bace-ee44-448d-90af-7bf713f43827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:25.403208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b72d-3314-4f2b-ba3e-666b8c173add None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:25.403943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b72d-3314-4f2b-ba3e-666b8c173add None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:25.404238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b72d-3314-4f2b-ba3e-666b8c173add None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:25.405606 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:20:25.410996 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193815b2-e357-41e4-b6d7-72010ae7f188 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:25.411284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193815b2-e357-41e4-b6d7-72010ae7f188 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:25.411563 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193815b2-e357-41e4-b6d7-72010ae7f188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:25.445711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:25.456685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG passlib.handlers.bcrypt [None req-193815b2-e357-41e4-b6d7-72010ae7f188 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81397) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 03:20:25.457069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG passlib.handlers.bcrypt [None req-193815b2-e357-41e4-b6d7-72010ae7f188 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81397) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 03:20:25.506843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-193815b2-e357-41e4-b6d7-72010ae7f188 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:25.508386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-193815b2-e357-41e4-b6d7-72010ae7f188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:25.609429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:20:25.710220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075bace-ee44-448d-90af-7bf713f43827 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:25.735990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:25.816756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075bace-ee44-448d-90af-7bf713f43827 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:25.849722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39a780-44e7-4566-b4a3-eba97bb84701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:25.850345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39a780-44e7-4566-b4a3-eba97bb84701 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:25.850626 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39a780-44e7-4566-b4a3-eba97bb84701 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:25.850898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39a780-44e7-4566-b4a3-eba97bb84701 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:25.861816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39a780-44e7-4566-b4a3-eba97bb84701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-9b39a780-44e7-4566-b4a3-eba97bb84701 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:25.870817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:25.871924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:20:25.873343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:20:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:25.876126 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193815b2-e357-41e4-b6d7-72010ae7f188 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:25.877969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39a780-44e7-4566-b4a3-eba97bb84701 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:25.959276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:25.977096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193815b2-e357-41e4-b6d7-72010ae7f188 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:25.978023 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39a780-44e7-4566-b4a3-eba97bb84701 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:25.980132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:26.011908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85420d-7361-4ec3-bc78-7c9175d66555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:26.012545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85420d-7361-4ec3-bc78-7c9175d66555 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:26.013449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85420d-7361-4ec3-bc78-7c9175d66555 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:26.013724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85420d-7361-4ec3-bc78-7c9175d66555 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:26.014489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85420d-7361-4ec3-bc78-7c9175d66555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:26.014793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85420d-7361-4ec3-bc78-7c9175d66555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:26.016181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85420d-7361-4ec3-bc78-7c9175d66555 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:26.017649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6e8ca-9ead-42e7-959f-ca32eee4226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:26.018523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6e8ca-9ead-42e7-959f-ca32eee4226a None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:26.018808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6e8ca-9ead-42e7-959f-ca32eee4226a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:26.019086 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6e8ca-9ead-42e7-959f-ca32eee4226a None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:26.020060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6e8ca-9ead-42e7-959f-ca32eee4226a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:26.021550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6e8ca-9ead-42e7-959f-ca32eee4226a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:26.030876 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:20:26.033711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.sql.core [None req-fae6e8ca-9ead-42e7-959f-ca32eee4226a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 03:20:26.033711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 03:20:26.033711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [parameters: {'id': '46c69aa833d340309cc0814c198e3468', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 03:20:26.033711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 03:20:26.036978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85420d-7361-4ec3-bc78-7c9175d66555 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fae6e8ca-9ead-42e7-959f-ca32eee4226a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 03:20:26.053920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 03:20:26.054789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application yield resource Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise self.value Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application session.commit() Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 03:20:26.055668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.flush() Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application compat.raise_( Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 03:20:26.056549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 03:20:26.057454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 03:20:26.058194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [parameters: {'id': '46c69aa833d340309cc0814c198e3468', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 03:20:26.058975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:26.059784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:26.060711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 8/16] 10.222.0.20 () {60 vars in 1137 bytes} [Wed Nov 2 03:20:25 2022] POST /identity/v3/domains => generated 190 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:26.062132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6e8ca-9ead-42e7-959f-ca32eee4226a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:26.142784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85420d-7361-4ec3-bc78-7c9175d66555 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:26.162512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6e8ca-9ead-42e7-959f-ca32eee4226a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:26.176079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1f57b-6010-4eb7-9eda-c71f4e5c8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:26.176748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f57b-6010-4eb7-9eda-c71f4e5c8af5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:26.177034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f57b-6010-4eb7-9eda-c71f4e5c8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:26.177356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f57b-6010-4eb7-9eda-c71f4e5c8af5 None admin] PATH_INFO: `/v3/users/74e842bce75f4436a698ca681099c480` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:26.178495 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1f57b-6010-4eb7-9eda-c71f4e5c8af5 None admin] RBAC: Authorizing `identity:get_user(user_id=74e842bce75f4436a698ca681099c480)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:26.179979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1f57b-6010-4eb7-9eda-c71f4e5c8af5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:26.181562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:26 2022] GET /identity/v3/users/74e842bce75f4436a698ca681099c480 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:20:26.187121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1f57b-6010-4eb7-9eda-c71f4e5c8af5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:26.195868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c000418-e902-4b1d-a240-54b2b36b673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:26.196443 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c000418-e902-4b1d-a240-54b2b36b673e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:26.196749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c000418-e902-4b1d-a240-54b2b36b673e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:26.197023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c000418-e902-4b1d-a240-54b2b36b673e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:26.202035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:26.215515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c000418-e902-4b1d-a240-54b2b36b673e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:26.217077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c000418-e902-4b1d-a240-54b2b36b673e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7c000418-e902-4b1d-a240-54b2b36b673e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:20:26.233668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:26.234528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:20:26.235298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:20:26.235298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:20:26.235298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:26.235298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:20:26.240639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c000418-e902-4b1d-a240-54b2b36b673e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:26.265818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:26.288025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1f57b-6010-4eb7-9eda-c71f4e5c8af5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:26.321137 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b268f-f072-4477-a9b5-e838d620282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:26.321791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b268f-f072-4477-a9b5-e838d620282e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:26.322075 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b268f-f072-4477-a9b5-e838d620282e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:26.322349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b268f-f072-4477-a9b5-e838d620282e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:26.323460 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b268f-f072-4477-a9b5-e838d620282e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:26.324949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b268f-f072-4477-a9b5-e838d620282e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:26.327107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:20:26.332728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b268f-f072-4477-a9b5-e838d620282e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:26.350322 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c000418-e902-4b1d-a240-54b2b36b673e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:26.383944 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a3fd1-156e-495d-856b-8f790478876b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:26.384579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a3fd1-156e-495d-856b-8f790478876b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:26.384860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a3fd1-156e-495d-856b-8f790478876b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:26.385130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a3fd1-156e-495d-856b-8f790478876b None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:26.385768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a3fd1-156e-495d-856b-8f790478876b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:26.386069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a3fd1-156e-495d-856b-8f790478876b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:26.387443 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a3fd1-156e-495d-856b-8f790478876b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:26.404995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:20:26.415087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:26.436886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b268f-f072-4477-a9b5-e838d620282e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:26.473641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da43271-9363-4e5f-aad8-d32f81cdb0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:26.474330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da43271-9363-4e5f-aad8-d32f81cdb0aa None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:26.474616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da43271-9363-4e5f-aad8-d32f81cdb0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:26.474899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da43271-9363-4e5f-aad8-d32f81cdb0aa None admin] PATH_INFO: `/v3/domains/default/users/74e842bce75f4436a698ca681099c480/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:26.476969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da43271-9363-4e5f-aad8-d32f81cdb0aa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=74e842bce75f4436a698ca681099c480, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:26.478462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da43271-9363-4e5f-aad8-d32f81cdb0aa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:26.595975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 11/21] 10.222.0.20 () {58 vars in 1361 bytes} [Wed Nov 2 03:20:26 2022] PUT /identity/v3/domains/default/users/74e842bce75f4436a698ca681099c480/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:20:28.941358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd76e5-e04c-46cb-ba8e-8c66ef68f5a8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:28.941880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd76e5-e04c-46cb-ba8e-8c66ef68f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:28.941982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd76e5-e04c-46cb-ba8e-8c66ef68f5a8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:28.945436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:28.951452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3262e13-c1a5-451b-89f9-1aed968aac33 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:28.951897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3262e13-c1a5-451b-89f9-1aed968aac33 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:28.952017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3262e13-c1a5-451b-89f9-1aed968aac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:28.977349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e3262e13-c1a5-451b-89f9-1aed968aac33 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:28.978905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e3262e13-c1a5-451b-89f9-1aed968aac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:29.006020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ce98d-d519-430b-bb70-4822c0a562bc None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:29.006644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ce98d-d519-430b-bb70-4822c0a562bc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:29.007109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ce98d-d519-430b-bb70-4822c0a562bc None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:29.008958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 12/23] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:20:29.017998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70da9f-9829-4a6e-99b9-99e2cebdc04a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:29.018280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70da9f-9829-4a6e-99b9-99e2cebdc04a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:29.018556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70da9f-9829-4a6e-99b9-99e2cebdc04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:29.055287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cf70da9f-9829-4a6e-99b9-99e2cebdc04a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:29.055287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cf70da9f-9829-4a6e-99b9-99e2cebdc04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:29.102851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:29.173774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:20:29.410269 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e8479-2ec3-4c93-9402-c9dda8b2cd0d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:29.410945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e8479-2ec3-4c93-9402-c9dda8b2cd0d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:29.411426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e8479-2ec3-4c93-9402-c9dda8b2cd0d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:29.415787 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 13/26] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:29.422326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412280-0baa-4e30-9fbb-46486447c457 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:29.422620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412280-0baa-4e30-9fbb-46486447c457 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:29.422902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412280-0baa-4e30-9fbb-46486447c457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:29.444775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-99412280-0baa-4e30-9fbb-46486447c457 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:29.445072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e8479-2ec3-4c93-9402-c9dda8b2cd0d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:29.445955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-99412280-0baa-4e30-9fbb-46486447c457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:29.449248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:29.535020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:29.573207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:29.620671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e8479-2ec3-4c93-9402-c9dda8b2cd0d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:29.672419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ca1db-3e7a-4992-8a05-5a3ec4c53a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:29.673002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ca1db-3e7a-4992-8a05-5a3ec4c53a99 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:29.673288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ca1db-3e7a-4992-8a05-5a3ec4c53a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:29.673563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ca1db-3e7a-4992-8a05-5a3ec4c53a99 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:29.674245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ca1db-3e7a-4992-8a05-5a3ec4c53a99 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:29.675769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ca1db-3e7a-4992-8a05-5a3ec4c53a99 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:29.701959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99412280-0baa-4e30-9fbb-46486447c457 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:29.734017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 14/28] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Nov 2 03:20:29 2022] POST /identity/v3/roles => generated 219 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:20:29.785443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3e7e-f359-43bf-9b80-51118318b553 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:29.786112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3e7e-f359-43bf-9b80-51118318b553 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:29.786608 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3e7e-f359-43bf-9b80-51118318b553 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:29.790524 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 15/29] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:29.802408 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e1482-68f2-41aa-b6a5-d8e6f872fd07 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:29.803453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e1482-68f2-41aa-b6a5-d8e6f872fd07 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:29.804213 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e1482-68f2-41aa-b6a5-d8e6f872fd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:29.844701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cc3e1482-68f2-41aa-b6a5-d8e6f872fd07 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:29.847245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cc3e1482-68f2-41aa-b6a5-d8e6f872fd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:29.875596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99412280-0baa-4e30-9fbb-46486447c457 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:29.924271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a613ec-398b-469e-a8a0-491f8d10da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:29.925190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a613ec-398b-469e-a8a0-491f8d10da2a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:29.925614 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a613ec-398b-469e-a8a0-491f8d10da2a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:29.926049 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a613ec-398b-469e-a8a0-491f8d10da2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:29.939146 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:29.942394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a613ec-398b-469e-a8a0-491f8d10da2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:29.944775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a613ec-398b-469e-a8a0-491f8d10da2a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-39a613ec-398b-469e-a8a0-491f8d10da2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:20:29.964052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:29.965021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:20:29.965921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:20:29.965921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:20:29.965921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:29.965921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:29.966541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a613ec-398b-469e-a8a0-491f8d10da2a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:29.977845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 16/31] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:29.979330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e1482-68f2-41aa-b6a5-d8e6f872fd07 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:30.105383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:30.169421 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a613ec-398b-469e-a8a0-491f8d10da2a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:30.191239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e1482-68f2-41aa-b6a5-d8e6f872fd07 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:30.217188 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7ed24-91d6-4205-a19e-3b21c7a2b017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:30.218375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ed24-91d6-4205-a19e-3b21c7a2b017 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.218854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ed24-91d6-4205-a19e-3b21c7a2b017 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.219362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ed24-91d6-4205-a19e-3b21c7a2b017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:30.239514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a82f97-04fe-4572-8d0b-03925dae0010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:30.240364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a82f97-04fe-4572-8d0b-03925dae0010 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.240830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a82f97-04fe-4572-8d0b-03925dae0010 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.241496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a82f97-04fe-4572-8d0b-03925dae0010 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:30.242302 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a82f97-04fe-4572-8d0b-03925dae0010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:30.242739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a82f97-04fe-4572-8d0b-03925dae0010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:30.244260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a82f97-04fe-4572-8d0b-03925dae0010 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:30.247446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7ed24-91d6-4205-a19e-3b21c7a2b017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-74a7ed24-91d6-4205-a19e-3b21c7a2b017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:30.254405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:30.255466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:30.256433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:30.258592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:20:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:30.263470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 17/33] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:30.265830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7ed24-91d6-4205-a19e-3b21c7a2b017 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:30.269133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a82f97-04fe-4572-8d0b-03925dae0010 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:30.347740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:30.406757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a82f97-04fe-4572-8d0b-03925dae0010 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:30.409966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7ed24-91d6-4205-a19e-3b21c7a2b017 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:30.436454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:30.448965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832a45-b2cb-42a7-a96a-4c9764b10069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:30.449885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832a45-b2cb-42a7-a96a-4c9764b10069 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.450531 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832a45-b2cb-42a7-a96a-4c9764b10069 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.451008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832a45-b2cb-42a7-a96a-4c9764b10069 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:30.451956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da832a45-b2cb-42a7-a96a-4c9764b10069 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:30.452536 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da832a45-b2cb-42a7-a96a-4c9764b10069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:30.454264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da832a45-b2cb-42a7-a96a-4c9764b10069 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:30.454916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1135e6-63e2-4347-803a-02b8bb480369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:30.455636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1135e6-63e2-4347-803a-02b8bb480369 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.456011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1135e6-63e2-4347-803a-02b8bb480369 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.456671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1135e6-63e2-4347-803a-02b8bb480369 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:30.457426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1135e6-63e2-4347-803a-02b8bb480369 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:30.459403 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1135e6-63e2-4347-803a-02b8bb480369 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:30.473675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 17/34] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:30.474858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832a45-b2cb-42a7-a96a-4c9764b10069 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:30.497526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 18/35] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:20:30 2022] POST /identity/v3/projects => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:20:30.498816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1135e6-63e2-4347-803a-02b8bb480369 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:30.698177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1135e6-63e2-4347-803a-02b8bb480369 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:30.702857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832a45-b2cb-42a7-a96a-4c9764b10069 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:30.724260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:30.748018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0db79-4949-4f6a-ba0e-b4afee743fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:30.749107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0db79-4949-4f6a-ba0e-b4afee743fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.749603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0db79-4949-4f6a-ba0e-b4afee743fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.750159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0db79-4949-4f6a-ba0e-b4afee743fe3 None admin] PATH_INFO: `/v3/users/74e842bce75f4436a698ca681099c480` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:30.750375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b232c6-7200-46f6-bfe7-473c21f40153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:30.751158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b232c6-7200-46f6-bfe7-473c21f40153 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.751575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b232c6-7200-46f6-bfe7-473c21f40153 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.751878 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0db79-4949-4f6a-ba0e-b4afee743fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=74e842bce75f4436a698ca681099c480)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:30.751991 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b232c6-7200-46f6-bfe7-473c21f40153 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:30.753713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0db79-4949-4f6a-ba0e-b4afee743fe3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:30.753817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b232c6-7200-46f6-bfe7-473c21f40153 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:30.755087 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b232c6-7200-46f6-bfe7-473c21f40153 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:30.755762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 19/36] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:30 2022] GET /identity/v3/users/74e842bce75f4436a698ca681099c480 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:30.761978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0db79-4949-4f6a-ba0e-b4afee743fe3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:30.817816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:30.887920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0db79-4949-4f6a-ba0e-b4afee743fe3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:30.889884 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Nov 2 03:20:30 2022] POST /identity/v3/roles => generated 225 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:20:30.891439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7af999-8a7a-42ab-bf95-b95f9d084719 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.891734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7af999-8a7a-42ab-bf95-b95f9d084719 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.892385 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7af999-8a7a-42ab-bf95-b95f9d084719 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:30.893796 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 19/38] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:30.894741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a6883-b758-4063-a654-c7ee9bc44742 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.895026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a6883-b758-4063-a654-c7ee9bc44742 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.895301 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a6883-b758-4063-a654-c7ee9bc44742 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:30.896595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 20/39] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:30.899185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d17e87-b3d6-4e44-acee-6c01145ca6ee None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.899710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d17e87-b3d6-4e44-acee-6c01145ca6ee None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.900236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d17e87-b3d6-4e44-acee-6c01145ca6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:30.920671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b1d17e87-b3d6-4e44-acee-6c01145ca6ee None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:30.922256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b1d17e87-b3d6-4e44-acee-6c01145ca6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:30.932510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26d5e8-36ca-4675-a350-003ca075b09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:30.933508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26d5e8-36ca-4675-a350-003ca075b09b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.933508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26d5e8-36ca-4675-a350-003ca075b09b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.933791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26d5e8-36ca-4675-a350-003ca075b09b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:30.936077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26d5e8-36ca-4675-a350-003ca075b09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:30.937372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26d5e8-36ca-4675-a350-003ca075b09b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:30.943650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 20/40] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:30.943650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca33d75-2923-43ac-b56b-b56336125d55 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:30.943650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca33d75-2923-43ac-b56b-b56336125d55 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:30.943650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca33d75-2923-43ac-b56b-b56336125d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:31.020489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 21/41] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:31.020489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d17e87-b3d6-4e44-acee-6c01145ca6ee None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:31.072491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0ca33d75-2923-43ac-b56b-b56336125d55 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:31.076175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0ca33d75-2923-43ac-b56b-b56336125d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:31.157502 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:31.167232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d17e87-b3d6-4e44-acee-6c01145ca6ee None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:31.170598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:31.207898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3568fa-6fa1-4114-9384-456e24e774e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:31.208814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3568fa-6fa1-4114-9384-456e24e774e3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:31.209334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3568fa-6fa1-4114-9384-456e24e774e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:31.209776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3568fa-6fa1-4114-9384-456e24e774e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:31.210670 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3568fa-6fa1-4114-9384-456e24e774e3 None admin] RBAC: Adding query filter params (role.id=9a4fa7f48c24440cae54bb4ec26b5b49, scope.domain.id=default, user.id=74e842bce75f4436a698ca681099c480) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:31.211148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3568fa-6fa1-4114-9384-456e24e774e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:31.212894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3568fa-6fa1-4114-9384-456e24e774e3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:31.222527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Nov 2 03:20:31 2022] GET /identity/v3/role_assignments?user.id=74e842bce75f4436a698ca681099c480&scope.domain.id=default&role.id=9a4fa7f48c24440cae54bb4ec26b5b49 => generated 530 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:31.316138 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca33d75-2923-43ac-b56b-b56336125d55 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:31.359816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:31.426900 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca33d75-2923-43ac-b56b-b56336125d55 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:31.428389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3568fa-6fa1-4114-9384-456e24e774e3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:31.466972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15563d-cbf5-48d4-8518-c81b262929c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:31.467613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15563d-cbf5-48d4-8518-c81b262929c0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:31.467902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15563d-cbf5-48d4-8518-c81b262929c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:31.468185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15563d-cbf5-48d4-8518-c81b262929c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:31.469359 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15563d-cbf5-48d4-8518-c81b262929c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:31.470818 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15563d-cbf5-48d4-8518-c81b262929c0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:31.472586 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 22/44] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:31.478009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15563d-cbf5-48d4-8518-c81b262929c0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:31.537720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3568fa-6fa1-4114-9384-456e24e774e3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:31.571307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0806d9-3a24-4a26-b5d3-c0fd7c6eb656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:31.571850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0806d9-3a24-4a26-b5d3-c0fd7c6eb656 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:31.572134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0806d9-3a24-4a26-b5d3-c0fd7c6eb656 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:31.572415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0806d9-3a24-4a26-b5d3-c0fd7c6eb656 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:31.573106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0806d9-3a24-4a26-b5d3-c0fd7c6eb656 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:31.574503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0806d9-3a24-4a26-b5d3-c0fd7c6eb656 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:31.577937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15563d-cbf5-48d4-8518-c81b262929c0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:31.585780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:31.590235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Nov 2 03:20:31 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:20:31.617005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345183eb-f96d-4e5e-a047-703ee4312bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:31.617642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345183eb-f96d-4e5e-a047-703ee4312bfa None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:31.617934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345183eb-f96d-4e5e-a047-703ee4312bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:31.618213 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345183eb-f96d-4e5e-a047-703ee4312bfa None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:31.618890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345183eb-f96d-4e5e-a047-703ee4312bfa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:31.620377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345183eb-f96d-4e5e-a047-703ee4312bfa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:31.650023 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:20:31 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:20:33.832229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ff3a-4f92-478a-a0a3-6a1049129ba5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:33.832789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ff3a-4f92-478a-a0a3-6a1049129ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:33.832873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ff3a-4f92-478a-a0a3-6a1049129ba5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:33.834154 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:33.839463 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892442d-01fa-4311-aae6-d50214028177 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:33.839866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892442d-01fa-4311-aae6-d50214028177 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:33.840027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892442d-01fa-4311-aae6-d50214028177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:33.858825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8892442d-01fa-4311-aae6-d50214028177 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:33.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8892442d-01fa-4311-aae6-d50214028177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:33.923849 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:34.195098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72ff3a-4f92-478a-a0a3-6a1049129ba5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:34.223649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:34.296141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72ff3a-4f92-478a-a0a3-6a1049129ba5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:34.329050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5a500-3a42-4f09-94b8-d68b28ba9255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:34.329690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5a500-3a42-4f09-94b8-d68b28ba9255 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:34.329982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5a500-3a42-4f09-94b8-d68b28ba9255 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:34.330262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5a500-3a42-4f09-94b8-d68b28ba9255 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:34.331416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5a500-3a42-4f09-94b8-d68b28ba9255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:34.332913 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5a500-3a42-4f09-94b8-d68b28ba9255 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:34.334476 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 25/49] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:34.340191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892442d-01fa-4311-aae6-d50214028177 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:34.429077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:34.442391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892442d-01fa-4311-aae6-d50214028177 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:34.476404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f0629-f7ee-4317-a155-b7a731516fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:34.477049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f0629-f7ee-4317-a155-b7a731516fc6 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:34.477334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f0629-f7ee-4317-a155-b7a731516fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:34.477611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f0629-f7ee-4317-a155-b7a731516fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:34.478264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f0629-f7ee-4317-a155-b7a731516fc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:34.479714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f0629-f7ee-4317-a155-b7a731516fc6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:34.506846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Nov 2 03:20:34 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:20:36.636674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d95e01-bad0-418a-91d1-05295491817a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:36.637230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d95e01-bad0-418a-91d1-05295491817a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:36.637320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d95e01-bad0-418a-91d1-05295491817a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:36.638820 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 26/51] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:36.643889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda95bd-4acf-4007-9fa3-a8d3a90a7d37 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:36.644297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda95bd-4acf-4007-9fa3-a8d3a90a7d37 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:36.644469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda95bd-4acf-4007-9fa3-a8d3a90a7d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:36.662563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0bda95bd-4acf-4007-9fa3-a8d3a90a7d37 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:36.663742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0bda95bd-4acf-4007-9fa3-a8d3a90a7d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:36.728694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 26/52] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:36.998302 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d95e01-bad0-418a-91d1-05295491817a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:37.093892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:37.101056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d95e01-bad0-418a-91d1-05295491817a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:37.133865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab112640-926a-40d9-9ebc-759401567fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:37.134495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab112640-926a-40d9-9ebc-759401567fcd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:37.134782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab112640-926a-40d9-9ebc-759401567fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:37.135062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab112640-926a-40d9-9ebc-759401567fcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:37.136178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab112640-926a-40d9-9ebc-759401567fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:37.138293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab112640-926a-40d9-9ebc-759401567fcd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:37.139840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:37.145477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda95bd-4acf-4007-9fa3-a8d3a90a7d37 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:37.212355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:37.243969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda95bd-4acf-4007-9fa3-a8d3a90a7d37 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:37.276968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c355f9d-5a90-4c48-8337-7c873e3166d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:37.277507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355f9d-5a90-4c48-8337-7c873e3166d4 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:37.277819 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355f9d-5a90-4c48-8337-7c873e3166d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:37.278103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355f9d-5a90-4c48-8337-7c873e3166d4 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:37.278754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c355f9d-5a90-4c48-8337-7c873e3166d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:37.280185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c355f9d-5a90-4c48-8337-7c873e3166d4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:37.305640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 27/54] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:20:37 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:20:40.584048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa6d57-d84b-4c48-96bc-761c3a0f60f0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:40.585134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa6d57-d84b-4c48-96bc-761c3a0f60f0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:40.585675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa6d57-d84b-4c48-96bc-761c3a0f60f0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:40.587326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 28/55] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:40.593657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03796c-b6b4-4741-a810-1d95cd9bf8ba None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:40.594610 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03796c-b6b4-4741-a810-1d95cd9bf8ba None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:40.595105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03796c-b6b4-4741-a810-1d95cd9bf8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:40.627080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6d03796c-b6b4-4741-a810-1d95cd9bf8ba None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:40.628668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6d03796c-b6b4-4741-a810-1d95cd9bf8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:40.703536 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dedf9e-1941-4c87-be51-7dfd26fbe1ae None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:40.704169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dedf9e-1941-4c87-be51-7dfd26fbe1ae None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:40.704698 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dedf9e-1941-4c87-be51-7dfd26fbe1ae None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:40.706292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 29/56] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:20:40.722638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c690b-24b4-45b7-bbec-7ad563fdf7bd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:40.723299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c690b-24b4-45b7-bbec-7ad563fdf7bd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:40.723779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c690b-24b4-45b7-bbec-7ad563fdf7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:40.730146 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 28/57] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:40.744285 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b40c690b-24b4-45b7-bbec-7ad563fdf7bd None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:40.745863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b40c690b-24b4-45b7-bbec-7ad563fdf7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:40.839600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 30/58] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:40.844691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1383d9-e4be-455a-b1a9-4bf196f08027 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:40.845232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1383d9-e4be-455a-b1a9-4bf196f08027 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:40.845732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1383d9-e4be-455a-b1a9-4bf196f08027 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:40.847273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 29/59] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:40.852515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247acb-cd89-474a-9dd7-912fc291c080 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:40.853036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247acb-cd89-474a-9dd7-912fc291c080 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:40.853513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247acb-cd89-474a-9dd7-912fc291c080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:40.873773 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f0247acb-cd89-474a-9dd7-912fc291c080 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:40.875292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f0247acb-cd89-474a-9dd7-912fc291c080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:41.046846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784e76-9ff3-43f4-809a-ec0b63ed85ba None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.047371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784e76-9ff3-43f4-809a-ec0b63ed85ba None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.047873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784e76-9ff3-43f4-809a-ec0b63ed85ba None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.053710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 30/60] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:41.062496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9258124-f1b6-444c-96ac-b53ee1459cd8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.063136 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9258124-f1b6-444c-96ac-b53ee1459cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.063614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9258124-f1b6-444c-96ac-b53ee1459cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.095679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 31/61] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:41.100127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b9258124-f1b6-444c-96ac-b53ee1459cd8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:41.101604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b9258124-f1b6-444c-96ac-b53ee1459cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:41.130439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0247acb-cd89-474a-9dd7-912fc291c080 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:41.171836 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:41.186030 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:41.208004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 31/62] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:41.208919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9258124-f1b6-444c-96ac-b53ee1459cd8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:41.324958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0247acb-cd89-474a-9dd7-912fc291c080 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:41.385208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9258124-f1b6-444c-96ac-b53ee1459cd8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:41.388213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06684c5-8fb6-4ad8-96a0-06a3ce71511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:41.388889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06684c5-8fb6-4ad8-96a0-06a3ce71511f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.389367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06684c5-8fb6-4ad8-96a0-06a3ce71511f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.389818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06684c5-8fb6-4ad8-96a0-06a3ce71511f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.403121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06684c5-8fb6-4ad8-96a0-06a3ce71511f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a06684c5-8fb6-4ad8-96a0-06a3ce71511f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:41.408023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:41.409105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:20:41.409848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:41.412362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 32/63] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:20:41.413853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06684c5-8fb6-4ad8-96a0-06a3ce71511f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:41.432153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148069af-b66e-4cfa-a1dc-c8f33d73e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:41.433091 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148069af-b66e-4cfa-a1dc-c8f33d73e18e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.433377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148069af-b66e-4cfa-a1dc-c8f33d73e18e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.434184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148069af-b66e-4cfa-a1dc-c8f33d73e18e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.450208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148069af-b66e-4cfa-a1dc-c8f33d73e18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-148069af-b66e-4cfa-a1dc-c8f33d73e18e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:41.457033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:41.457959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:20:41.458802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 32/64] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:20:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:41.459417 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148069af-b66e-4cfa-a1dc-c8f33d73e18e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:41.516051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:41.532689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:41.536927 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06684c5-8fb6-4ad8-96a0-06a3ce71511f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:41.574089 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19f74b-dacf-4427-9497-55e0c6025e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:41.574893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19f74b-dacf-4427-9497-55e0c6025e38 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.575354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19f74b-dacf-4427-9497-55e0c6025e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.575637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19f74b-dacf-4427-9497-55e0c6025e38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.585737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19f74b-dacf-4427-9497-55e0c6025e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:41.590505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148069af-b66e-4cfa-a1dc-c8f33d73e18e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7e19f74b-dacf-4427-9497-55e0c6025e38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:41.591283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:41.592115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:41.592908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 33/65] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:20:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:41.593523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19f74b-dacf-4427-9497-55e0c6025e38 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:41.627017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767025fe-573e-4a48-ac99-c870e0f10842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:41.627631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767025fe-573e-4a48-ac99-c870e0f10842 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.627914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767025fe-573e-4a48-ac99-c870e0f10842 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.628189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767025fe-573e-4a48-ac99-c870e0f10842 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.628878 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767025fe-573e-4a48-ac99-c870e0f10842 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:41.629184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767025fe-573e-4a48-ac99-c870e0f10842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:41.630572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767025fe-573e-4a48-ac99-c870e0f10842 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:41.639049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 33/66] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:20:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:41.639780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767025fe-573e-4a48-ac99-c870e0f10842 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:41.698343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19f74b-dacf-4427-9497-55e0c6025e38 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:41.732014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3144b39-902a-4b9f-ad57-738330c49487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:41.732793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144b39-902a-4b9f-ad57-738330c49487 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.733081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144b39-902a-4b9f-ad57-738330c49487 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.733357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144b39-902a-4b9f-ad57-738330c49487 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.734015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3144b39-902a-4b9f-ad57-738330c49487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:41.734319 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3144b39-902a-4b9f-ad57-738330c49487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:41.735685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3144b39-902a-4b9f-ad57-738330c49487 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:41.737086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767025fe-573e-4a48-ac99-c870e0f10842 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:41.743752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 34/67] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:41.745000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50418d69-4396-4808-8a8b-eebb89c83af3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.745287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50418d69-4396-4808-8a8b-eebb89c83af3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.745565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50418d69-4396-4808-8a8b-eebb89c83af3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.749883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 35/68] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:41.749883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50418d69-4396-4808-8a8b-eebb89c83af3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:41.750079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:41.758976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:41.773937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470168b-19d6-48ac-bd2e-294bc4f9f389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:41.774570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470168b-19d6-48ac-bd2e-294bc4f9f389 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.774854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470168b-19d6-48ac-bd2e-294bc4f9f389 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.775125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470168b-19d6-48ac-bd2e-294bc4f9f389 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.785523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470168b-19d6-48ac-bd2e-294bc4f9f389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5470168b-19d6-48ac-bd2e-294bc4f9f389 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:41.792229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:41.793683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:20:41.794443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:41.795068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470168b-19d6-48ac-bd2e-294bc4f9f389 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:41.855292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50418d69-4396-4808-8a8b-eebb89c83af3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:41.890461 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b201206-7411-49e5-8aa4-8a96c986f0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:41.890996 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b201206-7411-49e5-8aa4-8a96c986f0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.891281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b201206-7411-49e5-8aa4-8a96c986f0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.891559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b201206-7411-49e5-8aa4-8a96c986f0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.892215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b201206-7411-49e5-8aa4-8a96c986f0a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:41.892546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b201206-7411-49e5-8aa4-8a96c986f0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:41.892634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470168b-19d6-48ac-bd2e-294bc4f9f389 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:41.893916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b201206-7411-49e5-8aa4-8a96c986f0a9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:41.901537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:20:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:41.906228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b201206-7411-49e5-8aa4-8a96c986f0a9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:41.931994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9633319-23dc-4580-88d9-a1ac3e93cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:41.932653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633319-23dc-4580-88d9-a1ac3e93cb18 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.932938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633319-23dc-4580-88d9-a1ac3e93cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.933209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633319-23dc-4580-88d9-a1ac3e93cb18 None admin] PATH_INFO: `/v3/users/28d5854b2bc04ea7a32ebadc709ee034` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.946538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9633319-23dc-4580-88d9-a1ac3e93cb18 None admin] RBAC: Authorizing `identity:get_user(user_id=28d5854b2bc04ea7a32ebadc709ee034)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:41.948018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9633319-23dc-4580-88d9-a1ac3e93cb18 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:41.950176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:41 2022] GET /identity/v3/users/28d5854b2bc04ea7a32ebadc709ee034 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:41.951320 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952ac8f-f09d-4b86-b3bc-a82b744f4720 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:41.951609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952ac8f-f09d-4b86-b3bc-a82b744f4720 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:41.951889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952ac8f-f09d-4b86-b3bc-a82b744f4720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:41.967516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:41.970003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6952ac8f-f09d-4b86-b3bc-a82b744f4720 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:41.971358 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6952ac8f-f09d-4b86-b3bc-a82b744f4720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:41.991119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:42.002627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b201206-7411-49e5-8aa4-8a96c986f0a9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.036466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c10db-dad9-4acd-9e71-604ca00976ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.037114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c10db-dad9-4acd-9e71-604ca00976ef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.037322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 36/72] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:42.037420 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c10db-dad9-4acd-9e71-604ca00976ef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.037654 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c10db-dad9-4acd-9e71-604ca00976ef None admin] PATH_INFO: `/v3/users/74e842bce75f4436a698ca681099c480` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.038155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952ac8f-f09d-4b86-b3bc-a82b744f4720 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.049649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c10db-dad9-4acd-9e71-604ca00976ef None admin] RBAC: Authorizing `identity:get_user(user_id=74e842bce75f4436a698ca681099c480)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.051238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c10db-dad9-4acd-9e71-604ca00976ef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.053123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:41 2022] GET /identity/v3/users/74e842bce75f4436a698ca681099c480 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:42.054021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c10db-dad9-4acd-9e71-604ca00976ef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.154302 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952ac8f-f09d-4b86-b3bc-a82b744f4720 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.158929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c10db-dad9-4acd-9e71-604ca00976ef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.193723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034db5e-ae59-48ac-94d8-99c4be46fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.194007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d35137-2173-470b-b217-04fb4404323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.194499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034db5e-ae59-48ac-94d8-99c4be46fd5d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.194765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d35137-2173-470b-b217-04fb4404323c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.194856 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034db5e-ae59-48ac-94d8-99c4be46fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.195056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d35137-2173-470b-b217-04fb4404323c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.195175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034db5e-ae59-48ac-94d8-99c4be46fd5d None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.195343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d35137-2173-470b-b217-04fb4404323c None admin] PATH_INFO: `/v3/users/28d5854b2bc04ea7a32ebadc709ee034` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.195991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034db5e-ae59-48ac-94d8-99c4be46fd5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:42.196295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034db5e-ae59-48ac-94d8-99c4be46fd5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.196529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d35137-2173-470b-b217-04fb4404323c None admin] RBAC: Authorizing `identity:get_user(user_id=28d5854b2bc04ea7a32ebadc709ee034)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.197704 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034db5e-ae59-48ac-94d8-99c4be46fd5d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.197961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d35137-2173-470b-b217-04fb4404323c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.200282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 38/74] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:42 2022] GET /identity/v3/users/28d5854b2bc04ea7a32ebadc709ee034 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:42.205306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d35137-2173-470b-b217-04fb4404323c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.208761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:42.209578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:20:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:42.210433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034db5e-ae59-48ac-94d8-99c4be46fd5d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.235815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:42.319216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034db5e-ae59-48ac-94d8-99c4be46fd5d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.322684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d35137-2173-470b-b217-04fb4404323c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.352645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5adab2-b215-4072-a4df-82212a5205e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.353278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5adab2-b215-4072-a4df-82212a5205e7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.353568 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5adab2-b215-4072-a4df-82212a5205e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.353853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5adab2-b215-4072-a4df-82212a5205e7 None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.354967 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5adab2-b215-4072-a4df-82212a5205e7 None admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.356054 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4fe6-e0d4-4997-bef2-2b7b2050966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.356728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4fe6-e0d4-4997-bef2-2b7b2050966f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.357019 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4fe6-e0d4-4997-bef2-2b7b2050966f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.357151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5adab2-b215-4072-a4df-82212a5205e7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.357300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4fe6-e0d4-4997-bef2-2b7b2050966f None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.358439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e4fe6-e0d4-4997-bef2-2b7b2050966f None admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.358795 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:42 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:42.359564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5adab2-b215-4072-a4df-82212a5205e7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.359878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e4fe6-e0d4-4997-bef2-2b7b2050966f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.361683 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:42 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:42.362285 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4fe6-e0d4-4997-bef2-2b7b2050966f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.432333 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:42.445309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:42.460203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5adab2-b215-4072-a4df-82212a5205e7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.462406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4fe6-e0d4-4997-bef2-2b7b2050966f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.493730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ee947-845c-434f-af62-6efa210f1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.494355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ee947-845c-434f-af62-6efa210f1774 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.494638 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ee947-845c-434f-af62-6efa210f1774 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.494913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ee947-845c-434f-af62-6efa210f1774 None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.496523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ee947-845c-434f-af62-6efa210f1774 None admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.497124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f274d-8b73-42aa-a85b-2aae50f45975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.497780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f274d-8b73-42aa-a85b-2aae50f45975 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.497990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ee947-845c-434f-af62-6efa210f1774 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.498091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f274d-8b73-42aa-a85b-2aae50f45975 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.498338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f274d-8b73-42aa-a85b-2aae50f45975 None admin] PATH_INFO: `/v3/users/28d5854b2bc04ea7a32ebadc709ee034` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.499486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f274d-8b73-42aa-a85b-2aae50f45975 None admin] RBAC: Authorizing `identity:get_user(user_id=28d5854b2bc04ea7a32ebadc709ee034)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.499606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:42 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:42.500353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ee947-845c-434f-af62-6efa210f1774 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.500983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f274d-8b73-42aa-a85b-2aae50f45975 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.507048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:42 2022] GET /identity/v3/users/28d5854b2bc04ea7a32ebadc709ee034 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:42.507048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f274d-8b73-42aa-a85b-2aae50f45975 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.600879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ee947-845c-434f-af62-6efa210f1774 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.606771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f274d-8b73-42aa-a85b-2aae50f45975 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.637976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32acfc-5412-445b-acfe-590f2851f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.639119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32acfc-5412-445b-acfe-590f2851f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.639621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32acfc-5412-445b-acfe-590f2851f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.640044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32acfc-5412-445b-acfe-590f2851f9c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.641397 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32acfc-5412-445b-acfe-590f2851f9c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.641962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03b59-7dc0-4ce3-9849-0885146ae0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.642631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03b59-7dc0-4ce3-9849-0885146ae0f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.642857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32acfc-5412-445b-acfe-590f2851f9c1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.642939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03b59-7dc0-4ce3-9849-0885146ae0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.643195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03b59-7dc0-4ce3-9849-0885146ae0f1 None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09/users/74e842bce75f4436a698ca681099c480/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.644433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 40/80] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:42.645196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32acfc-5412-445b-acfe-590f2851f9c1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.645323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b03b59-7dc0-4ce3-9849-0885146ae0f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a169391a6f324e26a7a0b1278ba35a09, user_id=74e842bce75f4436a698ca681099c480, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.646771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b03b59-7dc0-4ce3-9849-0885146ae0f1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.658479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:42.662772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 41/81] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:20:42 2022] PUT /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09/users/74e842bce75f4436a698ca681099c480/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:20:42.684852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03b59-7dc0-4ce3-9849-0885146ae0f1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.685003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:42.757068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32acfc-5412-445b-acfe-590f2851f9c1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.795300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03b59-7dc0-4ce3-9849-0885146ae0f1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.798605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906552f-8e67-41db-8bab-6282e84a95e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.799281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906552f-8e67-41db-8bab-6282e84a95e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.799563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906552f-8e67-41db-8bab-6282e84a95e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.799844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906552f-8e67-41db-8bab-6282e84a95e2 None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09/users/28d5854b2bc04ea7a32ebadc709ee034/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.801934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906552f-8e67-41db-8bab-6282e84a95e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a169391a6f324e26a7a0b1278ba35a09, user_id=28d5854b2bc04ea7a32ebadc709ee034, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.803433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906552f-8e67-41db-8bab-6282e84a95e2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.818925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 41/82] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:20:42 2022] PUT /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09/users/28d5854b2bc04ea7a32ebadc709ee034/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:20:42.819536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906552f-8e67-41db-8bab-6282e84a95e2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.855324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13982b4c-c077-491f-bd7c-ccd6ccebfe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:42.857486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13982b4c-c077-491f-bd7c-ccd6ccebfe7d None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:42.857486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13982b4c-c077-491f-bd7c-ccd6ccebfe7d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:42.857486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13982b4c-c077-491f-bd7c-ccd6ccebfe7d None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09/users/28d5854b2bc04ea7a32ebadc709ee034/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:42.860396 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13982b4c-c077-491f-bd7c-ccd6ccebfe7d None admin] RBAC: Authorizing `identity:create_grant(project_id=a169391a6f324e26a7a0b1278ba35a09, user_id=28d5854b2bc04ea7a32ebadc709ee034, role_id=d36d8bd9f47e4ea8bef7f96d37d55d3c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:42.862142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13982b4c-c077-491f-bd7c-ccd6ccebfe7d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:42.882068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 42/83] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:20:42 2022] PUT /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09/users/28d5854b2bc04ea7a32ebadc709ee034/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:20:42.883346 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13982b4c-c077-491f-bd7c-ccd6ccebfe7d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:42.933044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:42.957215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906552f-8e67-41db-8bab-6282e84a95e2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:42.972924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:43.013814 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e5718-b16e-4438-adc7-aec531db990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:43.014541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e5718-b16e-4438-adc7-aec531db990a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:43.014802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13982b4c-c077-491f-bd7c-ccd6ccebfe7d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:43.015053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e5718-b16e-4438-adc7-aec531db990a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:43.015348 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e5718-b16e-4438-adc7-aec531db990a None admin] PATH_INFO: `/v3/projects/ee804baf83614987b264d2a6654d296d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:43.020584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e5718-b16e-4438-adc7-aec531db990a None admin] RBAC: Authorizing `identity:get_project(project_id=ee804baf83614987b264d2a6654d296d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:43.022099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e5718-b16e-4438-adc7-aec531db990a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:43.024061 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 42/84] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:42 2022] GET /identity/v3/projects/ee804baf83614987b264d2a6654d296d => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:43.030790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e5718-b16e-4438-adc7-aec531db990a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:43.067258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17311b05-0ae7-4db3-8f2a-7977ce7cc768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:43.067930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311b05-0ae7-4db3-8f2a-7977ce7cc768 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:43.068218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311b05-0ae7-4db3-8f2a-7977ce7cc768 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:43.068527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311b05-0ae7-4db3-8f2a-7977ce7cc768 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:43.069206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17311b05-0ae7-4db3-8f2a-7977ce7cc768 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:43.070700 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17311b05-0ae7-4db3-8f2a-7977ce7cc768 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:43.107511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 43/85] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:20:42 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:20:43.200497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e5718-b16e-4438-adc7-aec531db990a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:43.241386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b5b9a-d11e-48a4-9edc-e50ce56c8030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:43.242453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5b9a-d11e-48a4-9edc-e50ce56c8030 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:43.242936 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5b9a-d11e-48a4-9edc-e50ce56c8030 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:43.243431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5b9a-d11e-48a4-9edc-e50ce56c8030 None admin] PATH_INFO: `/v3/projects/ee804baf83614987b264d2a6654d296d/users/28d5854b2bc04ea7a32ebadc709ee034/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:43.247132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b5b9a-d11e-48a4-9edc-e50ce56c8030 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee804baf83614987b264d2a6654d296d, user_id=28d5854b2bc04ea7a32ebadc709ee034, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:43.249046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b5b9a-d11e-48a4-9edc-e50ce56c8030 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:43.268521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 43/86] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:20:43 2022] PUT /identity/v3/projects/ee804baf83614987b264d2a6654d296d/users/28d5854b2bc04ea7a32ebadc709ee034/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:20:45.316761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d94e7-558c-4c0c-a79a-67d9cec73d59 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:45.317769 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d94e7-558c-4c0c-a79a-67d9cec73d59 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:45.318262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d94e7-558c-4c0c-a79a-67d9cec73d59 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:45.319810 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 44/87] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:45.326085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981ebe-15bc-45b0-a2f1-acfc0a4110e8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:45.326911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981ebe-15bc-45b0-a2f1-acfc0a4110e8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:45.327391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981ebe-15bc-45b0-a2f1-acfc0a4110e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:45.353807 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-17981ebe-15bc-45b0-a2f1-acfc0a4110e8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:45.355378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-17981ebe-15bc-45b0-a2f1-acfc0a4110e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:45.364261 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:45.447982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 44/88] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:46.015797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18318-f554-428f-bf3f-855b468ec43c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.016165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18318-f554-428f-bf3f-855b468ec43c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.016375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18318-f554-428f-bf3f-855b468ec43c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.017758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 45/89] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:46.023178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc061d-7ecb-4827-b351-5d0db979dedb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.023482 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc061d-7ecb-4827-b351-5d0db979dedb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.023770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc061d-7ecb-4827-b351-5d0db979dedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.062811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-53fc061d-7ecb-4827-b351-5d0db979dedb None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:46.064026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-53fc061d-7ecb-4827-b351-5d0db979dedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:46.075694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de18318-f554-428f-bf3f-855b468ec43c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:46.202884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 45/90] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:46.232895 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfb06-1496-46f3-bbe8-31353b69ac83 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.233208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfb06-1496-46f3-bbe8-31353b69ac83 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.233466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfb06-1496-46f3-bbe8-31353b69ac83 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.234841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 46/91] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:46.266490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb447c0-fa64-4a39-aa11-d9e381b6b415 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.266798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb447c0-fa64-4a39-aa11-d9e381b6b415 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.266975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb447c0-fa64-4a39-aa11-d9e381b6b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.274431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de18318-f554-428f-bf3f-855b468ec43c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:46.301308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6bb447c0-fa64-4a39-aa11-d9e381b6b415 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:46.302928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6bb447c0-fa64-4a39-aa11-d9e381b6b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:46.304779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:46.349894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e82d6-990b-401c-818e-4bcdc8991810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:46.350730 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e82d6-990b-401c-818e-4bcdc8991810 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.350853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e82d6-990b-401c-818e-4bcdc8991810 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.351097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e82d6-990b-401c-818e-4bcdc8991810 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.381260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e82d6-990b-401c-818e-4bcdc8991810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-aa2e82d6-990b-401c-818e-4bcdc8991810 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:46.387051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:46.387972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:46.388790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 46/92] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:20:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:46.398671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e82d6-990b-401c-818e-4bcdc8991810 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:46.425104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:46.431855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 47/93] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:20:46.434684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394aaf-0b78-43e6-a644-d1fb6605f33a None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.435178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394aaf-0b78-43e6-a644-d1fb6605f33a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.435704 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394aaf-0b78-43e6-a644-d1fb6605f33a None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.441868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 48/94] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:46.443816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e569df-2343-423f-8cb0-7200645f7fe8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.444283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e569df-2343-423f-8cb0-7200645f7fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.444791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e569df-2343-423f-8cb0-7200645f7fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.467620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-19e569df-2343-423f-8cb0-7200645f7fe8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:46.469168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-19e569df-2343-423f-8cb0-7200645f7fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:46.566655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e82d6-990b-401c-818e-4bcdc8991810 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:46.586174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 49/95] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:20:46.602707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be8b21-c106-40bc-a476-8d4f16c4819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:46.603567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be8b21-c106-40bc-a476-8d4f16c4819a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.603997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be8b21-c106-40bc-a476-8d4f16c4819a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.604415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be8b21-c106-40bc-a476-8d4f16c4819a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.605895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be8b21-c106-40bc-a476-8d4f16c4819a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:46.606356 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be8b21-c106-40bc-a476-8d4f16c4819a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:46.607943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be8b21-c106-40bc-a476-8d4f16c4819a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:46.616869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 47/96] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:20:46.623407 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e569df-2343-423f-8cb0-7200645f7fe8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:46.691936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858199-76cb-47eb-baac-7ec293e2b14e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.692556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858199-76cb-47eb-baac-7ec293e2b14e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.693035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858199-76cb-47eb-baac-7ec293e2b14e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.694789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 48/97] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:46.699234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858199-76cb-47eb-baac-7ec293e2b14e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:46.748861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:46.798070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e569df-2343-423f-8cb0-7200645f7fe8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:46.840874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858199-76cb-47eb-baac-7ec293e2b14e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:46.869085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:46.877443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6021f-d904-4fd2-a417-9c172d111b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:46.878105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6021f-d904-4fd2-a417-9c172d111b6e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.878395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6021f-d904-4fd2-a417-9c172d111b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.878672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6021f-d904-4fd2-a417-9c172d111b6e None admin] PATH_INFO: `/v3/users/74e842bce75f4436a698ca681099c480` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.880030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6021f-d904-4fd2-a417-9c172d111b6e None admin] RBAC: Authorizing `identity:get_user(user_id=74e842bce75f4436a698ca681099c480)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:46.881599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6021f-d904-4fd2-a417-9c172d111b6e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:46.883362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 50/98] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:46 2022] GET /identity/v3/users/74e842bce75f4436a698ca681099c480 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:46.884867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2beb1a-5448-495e-a638-bedeac238547 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.885378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2beb1a-5448-495e-a638-bedeac238547 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.885884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2beb1a-5448-495e-a638-bedeac238547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.897830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc97ea-3318-4fba-a771-0b84740c8241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:46.898494 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc97ea-3318-4fba-a771-0b84740c8241 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:46.898846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc97ea-3318-4fba-a771-0b84740c8241 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:46.899129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc97ea-3318-4fba-a771-0b84740c8241 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:46.908550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-de2beb1a-5448-495e-a638-bedeac238547 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:46.910124 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-de2beb1a-5448-495e-a638-bedeac238547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:46.914019 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc97ea-3318-4fba-a771-0b84740c8241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1cfc97ea-3318-4fba-a771-0b84740c8241 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:46.924148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:46.925096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 49/99] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:46.925838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc97ea-3318-4fba-a771-0b84740c8241 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:46.993488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 51/100] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:46.994193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2beb1a-5448-495e-a638-bedeac238547 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.042182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:47.050508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc97ea-3318-4fba-a771-0b84740c8241 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:47.090741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b7929-4ae1-4492-be7f-32788a523d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:47.091446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b7929-4ae1-4492-be7f-32788a523d34 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.091675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b7929-4ae1-4492-be7f-32788a523d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.091957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b7929-4ae1-4492-be7f-32788a523d34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.102722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b7929-4ae1-4492-be7f-32788a523d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1b8b7929-4ae1-4492-be7f-32788a523d34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:47.108729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:47.109577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:47.110305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 50/101] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:20:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:47.110923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b7929-4ae1-4492-be7f-32788a523d34 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.114871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2beb1a-5448-495e-a638-bedeac238547 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:47.145694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:47.155162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51a343-ca7d-4bd8-81d2-62000b2629d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:47.155784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51a343-ca7d-4bd8-81d2-62000b2629d7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.156068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51a343-ca7d-4bd8-81d2-62000b2629d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.156389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51a343-ca7d-4bd8-81d2-62000b2629d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.219465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b7929-4ae1-4492-be7f-32788a523d34 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:47.229131 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51a343-ca7d-4bd8-81d2-62000b2629d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:47.230670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51a343-ca7d-4bd8-81d2-62000b2629d7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:47.255916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec61b1-a2ae-4b1b-9cf0-eb2c1ba54cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:47.256567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec61b1-a2ae-4b1b-9cf0-eb2c1ba54cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.256862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec61b1-a2ae-4b1b-9cf0-eb2c1ba54cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.257144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec61b1-a2ae-4b1b-9cf0-eb2c1ba54cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.257814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec61b1-a2ae-4b1b-9cf0-eb2c1ba54cd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:47.258124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec61b1-a2ae-4b1b-9cf0-eb2c1ba54cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:47.259576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec61b1-a2ae-4b1b-9cf0-eb2c1ba54cd3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:47.268305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 51/102] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:20:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:47.269137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec61b1-a2ae-4b1b-9cf0-eb2c1ba54cd3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.293157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:47.331297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 52/103] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:20:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:20:47.332582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bc819-1fd1-4c91-aa75-dfb1cbf86361 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.332882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bc819-1fd1-4c91-aa75-dfb1cbf86361 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.333161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bc819-1fd1-4c91-aa75-dfb1cbf86361 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.334560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 53/104] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:47.335169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bc819-1fd1-4c91-aa75-dfb1cbf86361 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.365270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:47.374656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec61b1-a2ae-4b1b-9cf0-eb2c1ba54cd3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:47.408014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de285635-d1d5-4ba8-b63b-f4138472b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:47.408674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de285635-d1d5-4ba8-b63b-f4138472b58a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.408959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de285635-d1d5-4ba8-b63b-f4138472b58a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.409340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de285635-d1d5-4ba8-b63b-f4138472b58a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.419205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de285635-d1d5-4ba8-b63b-f4138472b58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-de285635-d1d5-4ba8-b63b-f4138472b58a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:47.424504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:47.425334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:47.426419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 52/105] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:47.427264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de285635-d1d5-4ba8-b63b-f4138472b58a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.444832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bc819-1fd1-4c91-aa75-dfb1cbf86361 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:47.478048 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035a61b-ca62-44fe-9cf8-f5dd9eee131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:47.478650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035a61b-ca62-44fe-9cf8-f5dd9eee131e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.478936 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035a61b-ca62-44fe-9cf8-f5dd9eee131e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.479211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035a61b-ca62-44fe-9cf8-f5dd9eee131e None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.479863 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035a61b-ca62-44fe-9cf8-f5dd9eee131e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:47.480389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035a61b-ca62-44fe-9cf8-f5dd9eee131e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:47.481807 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035a61b-ca62-44fe-9cf8-f5dd9eee131e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:47.489696 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 54/106] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:20:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:47.490472 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035a61b-ca62-44fe-9cf8-f5dd9eee131e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.510942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:47.531670 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de285635-d1d5-4ba8-b63b-f4138472b58a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:47.564401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5934816-b63b-4518-8134-4f37b492e088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:47.565066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5934816-b63b-4518-8134-4f37b492e088 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.565353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5934816-b63b-4518-8134-4f37b492e088 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.565630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5934816-b63b-4518-8134-4f37b492e088 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.577420 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5934816-b63b-4518-8134-4f37b492e088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:47.582307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f5934816-b63b-4518-8134-4f37b492e088 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:47.582428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:47.583231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:47.584217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 53/107] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:47.585397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5934816-b63b-4518-8134-4f37b492e088 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.594833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035a61b-ca62-44fe-9cf8-f5dd9eee131e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:47.629539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072828b-dd2c-4407-979c-f28b329e0291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:47.630135 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072828b-dd2c-4407-979c-f28b329e0291 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.630422 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072828b-dd2c-4407-979c-f28b329e0291 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.630700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072828b-dd2c-4407-979c-f28b329e0291 None admin] PATH_INFO: `/v3/users/28d5854b2bc04ea7a32ebadc709ee034` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.631843 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072828b-dd2c-4407-979c-f28b329e0291 None admin] RBAC: Authorizing `identity:get_user(user_id=28d5854b2bc04ea7a32ebadc709ee034)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:47.633321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072828b-dd2c-4407-979c-f28b329e0291 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:47.634899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 55/108] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:47 2022] GET /identity/v3/users/28d5854b2bc04ea7a32ebadc709ee034 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:47.636095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dca32-6d64-4de0-b35e-a2a17bdbe680 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.636286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dca32-6d64-4de0-b35e-a2a17bdbe680 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.637351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dca32-6d64-4de0-b35e-a2a17bdbe680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.654909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-521dca32-6d64-4de0-b35e-a2a17bdbe680 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:47.656108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-521dca32-6d64-4de0-b35e-a2a17bdbe680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:47.685849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5934816-b63b-4518-8134-4f37b492e088 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:47.719728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050142a9-2e7f-4e5e-870e-ad8c52414884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:47.720358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050142a9-2e7f-4e5e-870e-ad8c52414884 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.720621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 56/109] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:47.732644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050142a9-2e7f-4e5e-870e-ad8c52414884 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.732644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050142a9-2e7f-4e5e-870e-ad8c52414884 None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.732821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dca32-6d64-4de0-b35e-a2a17bdbe680 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.733668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050142a9-2e7f-4e5e-870e-ad8c52414884 None admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:47.735140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050142a9-2e7f-4e5e-870e-ad8c52414884 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:47.736823 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 54/110] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:47 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:47.737586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050142a9-2e7f-4e5e-870e-ad8c52414884 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.750995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:47.821488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:47.834744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dca32-6d64-4de0-b35e-a2a17bdbe680 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:47.844771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050142a9-2e7f-4e5e-870e-ad8c52414884 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:47.869560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6147ea-acbd-441a-b7ec-b03fb98aca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:47.870173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6147ea-acbd-441a-b7ec-b03fb98aca5b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.870458 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6147ea-acbd-441a-b7ec-b03fb98aca5b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.870995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6147ea-acbd-441a-b7ec-b03fb98aca5b None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.871637 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6147ea-acbd-441a-b7ec-b03fb98aca5b None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:47.871951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6147ea-acbd-441a-b7ec-b03fb98aca5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:47.873375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6147ea-acbd-441a-b7ec-b03fb98aca5b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:47.880756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29a083-7b5e-4ada-b4df-c039e393ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:47.881341 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a083-7b5e-4ada-b4df-c039e393ec80 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:47.881747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 57/111] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:20:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:47.882393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6147ea-acbd-441a-b7ec-b03fb98aca5b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.886863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a083-7b5e-4ada-b4df-c039e393ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:47.887324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a083-7b5e-4ada-b4df-c039e393ec80 None admin] PATH_INFO: `/v3/users/28d5854b2bc04ea7a32ebadc709ee034` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:47.889510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29a083-7b5e-4ada-b4df-c039e393ec80 None admin] RBAC: Authorizing `identity:get_user(user_id=28d5854b2bc04ea7a32ebadc709ee034)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:47.890976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29a083-7b5e-4ada-b4df-c039e393ec80 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:47.892730 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:47 2022] GET /identity/v3/users/28d5854b2bc04ea7a32ebadc709ee034 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:47.893348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29a083-7b5e-4ada-b4df-c039e393ec80 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:47.975017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:47.995279 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6147ea-acbd-441a-b7ec-b03fb98aca5b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:48.003067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29a083-7b5e-4ada-b4df-c039e393ec80 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:48.029705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396f40-c03f-4a83-8aeb-fa30f7f6bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:48.030315 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396f40-c03f-4a83-8aeb-fa30f7f6bc3c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:48.030602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396f40-c03f-4a83-8aeb-fa30f7f6bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:48.030880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396f40-c03f-4a83-8aeb-fa30f7f6bc3c None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:48.031540 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6396f40-c03f-4a83-8aeb-fa30f7f6bc3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:48.031848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6396f40-c03f-4a83-8aeb-fa30f7f6bc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:48.033289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6396f40-c03f-4a83-8aeb-fa30f7f6bc3c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:48.037095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89290-905d-41ab-8391-8c71d7419428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:48.037695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89290-905d-41ab-8391-8c71d7419428 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:48.037981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89290-905d-41ab-8391-8c71d7419428 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:48.038258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89290-905d-41ab-8391-8c71d7419428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:48.046225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 58/113] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:20:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:48.046225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396f40-c03f-4a83-8aeb-fa30f7f6bc3c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:48.057365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:48.111666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c89290-905d-41ab-8391-8c71d7419428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:48.113669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c89290-905d-41ab-8391-8c71d7419428 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:48.142735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396f40-c03f-4a83-8aeb-fa30f7f6bc3c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:48.175885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d860-edfe-4e5b-845d-e03cfbe7428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:48.176521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d860-edfe-4e5b-845d-e03cfbe7428e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:48.176810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d860-edfe-4e5b-845d-e03cfbe7428e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:48.177091 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d860-edfe-4e5b-845d-e03cfbe7428e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:48.177826 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8d860-edfe-4e5b-845d-e03cfbe7428e None admin] RBAC: Adding query filter params (role.id=9a4fa7f48c24440cae54bb4ec26b5b49, scope.project.id=a169391a6f324e26a7a0b1278ba35a09, user.id=74e842bce75f4436a698ca681099c480) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:48.178138 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8d860-edfe-4e5b-845d-e03cfbe7428e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:48.179591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8d860-edfe-4e5b-845d-e03cfbe7428e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:48.185908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:48.187240 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 59/114] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:20:48 2022] GET /identity/v3/role_assignments?user.id=74e842bce75f4436a698ca681099c480&scope.project.id=a169391a6f324e26a7a0b1278ba35a09&role.id=9a4fa7f48c24440cae54bb4ec26b5b49 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:48.187824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d860-edfe-4e5b-845d-e03cfbe7428e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:48.214091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 56/115] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:20:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:20:48.215583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89290-905d-41ab-8391-8c71d7419428 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:48.295634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:48.320523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d860-edfe-4e5b-845d-e03cfbe7428e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:48.332604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89290-905d-41ab-8391-8c71d7419428 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:48.358672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ab7a-0b3d-4178-9d8f-0ed1d2152409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:48.359654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ab7a-0b3d-4178-9d8f-0ed1d2152409 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:48.359951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ab7a-0b3d-4178-9d8f-0ed1d2152409 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:48.360235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ab7a-0b3d-4178-9d8f-0ed1d2152409 None admin] PATH_INFO: `/v3/users/28d5854b2bc04ea7a32ebadc709ee034` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:48.361427 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793ab7a-0b3d-4178-9d8f-0ed1d2152409 None admin] RBAC: Authorizing `identity:get_user(user_id=28d5854b2bc04ea7a32ebadc709ee034)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:48.363550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793ab7a-0b3d-4178-9d8f-0ed1d2152409 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:48.364657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 60/116] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:48 2022] GET /identity/v3/users/28d5854b2bc04ea7a32ebadc709ee034 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:48.365383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ab7a-0b3d-4178-9d8f-0ed1d2152409 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:48.370323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca87e1-40fa-4f4b-b2d6-c643f06a1a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:48.371818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca87e1-40fa-4f4b-b2d6-c643f06a1a6f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:48.372110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca87e1-40fa-4f4b-b2d6-c643f06a1a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:48.372381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca87e1-40fa-4f4b-b2d6-c643f06a1a6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:48.424350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:48.453216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca87e1-40fa-4f4b-b2d6-c643f06a1a6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:48.454692 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca87e1-40fa-4f4b-b2d6-c643f06a1a6f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:48.474675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ab7a-0b3d-4178-9d8f-0ed1d2152409 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:48.507993 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1943d11-9b93-4810-b40b-3de21693c697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:48.508667 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1943d11-9b93-4810-b40b-3de21693c697 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:48.508970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1943d11-9b93-4810-b40b-3de21693c697 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:48.509243 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1943d11-9b93-4810-b40b-3de21693c697 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:48.510349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1943d11-9b93-4810-b40b-3de21693c697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:48.512295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1943d11-9b93-4810-b40b-3de21693c697 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:48.513880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 61/117] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:48.514632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1943d11-9b93-4810-b40b-3de21693c697 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:48.529398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:48.555120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 57/118] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:20:48.556064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca87e1-40fa-4f4b-b2d6-c643f06a1a6f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:48.618089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1943d11-9b93-4810-b40b-3de21693c697 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:48.631841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:48.651737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789349-6c69-4c0b-94f0-b1b8e9ef0567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:48.653095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789349-6c69-4c0b-94f0-b1b8e9ef0567 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:48.653383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789349-6c69-4c0b-94f0-b1b8e9ef0567 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:48.653653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789349-6c69-4c0b-94f0-b1b8e9ef0567 None admin] PATH_INFO: `/v3/users/5c48b55fbaa44be0a599a1b824d2c948` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:48.655241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca87e1-40fa-4f4b-b2d6-c643f06a1a6f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:48.666604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789349-6c69-4c0b-94f0-b1b8e9ef0567 None admin] RBAC: Authorizing `identity:get_user(user_id=5c48b55fbaa44be0a599a1b824d2c948)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:48.668239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789349-6c69-4c0b-94f0-b1b8e9ef0567 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:48.669903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 62/119] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:48 2022] GET /identity/v3/users/5c48b55fbaa44be0a599a1b824d2c948 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:48.670677 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789349-6c69-4c0b-94f0-b1b8e9ef0567 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:48.690965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84918-f4ee-4f7e-907f-ca34008f7a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:48.691530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84918-f4ee-4f7e-907f-ca34008f7a8e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:48.691815 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84918-f4ee-4f7e-907f-ca34008f7a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:48.692093 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84918-f4ee-4f7e-907f-ca34008f7a8e None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:48.693256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb84918-f4ee-4f7e-907f-ca34008f7a8e None admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:48.694696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb84918-f4ee-4f7e-907f-ca34008f7a8e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:48.696318 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 58/120] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:48 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:48.697086 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84918-f4ee-4f7e-907f-ca34008f7a8e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:48.743834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:48.776236 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789349-6c69-4c0b-94f0-b1b8e9ef0567 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:48.799812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84918-f4ee-4f7e-907f-ca34008f7a8e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:48.810325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa47517-e791-4176-b581-24eb2db3bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:48.810949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa47517-e791-4176-b581-24eb2db3bab6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:48.811241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa47517-e791-4176-b581-24eb2db3bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:48.811526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa47517-e791-4176-b581-24eb2db3bab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:48.832978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339453f7-9083-4a32-9628-993e0a2e479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:48.833582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339453f7-9083-4a32-9628-993e0a2e479a None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:48.833865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339453f7-9083-4a32-9628-993e0a2e479a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:48.834137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339453f7-9083-4a32-9628-993e0a2e479a None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:48.834776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339453f7-9083-4a32-9628-993e0a2e479a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:48.836208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339453f7-9083-4a32-9628-993e0a2e479a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:48.851670 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:48.864037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 59/121] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:20:48 2022] POST /identity/v3/projects => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:20:48.864794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339453f7-9083-4a32-9628-993e0a2e479a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:48.886436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa47517-e791-4176-b581-24eb2db3bab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:48.888517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa47517-e791-4176-b581-24eb2db3bab6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:48.966794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:48.986896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339453f7-9083-4a32-9628-993e0a2e479a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:49.001944 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 63/122] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:20:49.002746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa47517-e791-4176-b581-24eb2db3bab6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:49.033714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b53ee4-48f8-4e4f-b7ef-2e1f05702c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:49.034605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b53ee4-48f8-4e4f-b7ef-2e1f05702c71 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:49.035044 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b53ee4-48f8-4e4f-b7ef-2e1f05702c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:49.035324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b53ee4-48f8-4e4f-b7ef-2e1f05702c71 None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:49.036552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b53ee4-48f8-4e4f-b7ef-2e1f05702c71 None admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:49.037954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b53ee4-48f8-4e4f-b7ef-2e1f05702c71 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:49.048142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 60/123] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:48 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:49.048142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b53ee4-48f8-4e4f-b7ef-2e1f05702c71 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:49.116589 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:49.121299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa47517-e791-4176-b581-24eb2db3bab6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:49.157092 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aec06-e456-4621-a525-f6f168facd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:49.157728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aec06-e456-4621-a525-f6f168facd12 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:49.158007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aec06-e456-4621-a525-f6f168facd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:49.158124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b53ee4-48f8-4e4f-b7ef-2e1f05702c71 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:49.158285 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aec06-e456-4621-a525-f6f168facd12 None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:49.159393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aec06-e456-4621-a525-f6f168facd12 None admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:49.160884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aec06-e456-4621-a525-f6f168facd12 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:49.162523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 64/124] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:49 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:49.163282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aec06-e456-4621-a525-f6f168facd12 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:49.197819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba3b08-c257-4812-ad94-b254886d397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:49.198667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba3b08-c257-4812-ad94-b254886d397a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:49.199263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba3b08-c257-4812-ad94-b254886d397a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:49.199560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba3b08-c257-4812-ad94-b254886d397a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:49.200279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba3b08-c257-4812-ad94-b254886d397a None admin] RBAC: Adding query filter params (role.id=f36bf60d6adc430cb9cd4b01f399fa18, scope.project.id=a169391a6f324e26a7a0b1278ba35a09, user.id=28d5854b2bc04ea7a32ebadc709ee034) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:49.200624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba3b08-c257-4812-ad94-b254886d397a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:49.202071 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba3b08-c257-4812-ad94-b254886d397a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:49.208377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 61/125] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:20:49 2022] GET /identity/v3/role_assignments?user.id=28d5854b2bc04ea7a32ebadc709ee034&scope.project.id=a169391a6f324e26a7a0b1278ba35a09&role.id=f36bf60d6adc430cb9cd4b01f399fa18 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:49.208938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:49.209144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba3b08-c257-4812-ad94-b254886d397a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:49.303286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aec06-e456-4621-a525-f6f168facd12 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:49.342757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0e90-9255-42e4-97ca-1bd051c5681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:49.343385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0e90-9255-42e4-97ca-1bd051c5681e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:49.343673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0e90-9255-42e4-97ca-1bd051c5681e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:49.343953 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0e90-9255-42e4-97ca-1bd051c5681e None admin] PATH_INFO: `/v3/projects/ee804baf83614987b264d2a6654d296d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:49.345164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e0e90-9255-42e4-97ca-1bd051c5681e None admin] RBAC: Authorizing `identity:get_project(project_id=ee804baf83614987b264d2a6654d296d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:49.346822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e0e90-9255-42e4-97ca-1bd051c5681e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:49.348801 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 65/126] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:49 2022] GET /identity/v3/projects/ee804baf83614987b264d2a6654d296d => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:49.349400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0e90-9255-42e4-97ca-1bd051c5681e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:49.350566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba3b08-c257-4812-ad94-b254886d397a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:49.384886 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:49.394217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aeade-c1c5-433f-8905-846844f9a8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:49.394844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aeade-c1c5-433f-8905-846844f9a8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:49.395133 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aeade-c1c5-433f-8905-846844f9a8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:49.395413 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aeade-c1c5-433f-8905-846844f9a8d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:49.396149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aeade-c1c5-433f-8905-846844f9a8d9 None admin] RBAC: Adding query filter params (role.id=d36d8bd9f47e4ea8bef7f96d37d55d3c, scope.project.id=a169391a6f324e26a7a0b1278ba35a09, user.id=28d5854b2bc04ea7a32ebadc709ee034) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:49.396480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aeade-c1c5-433f-8905-846844f9a8d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:49.397956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aeade-c1c5-433f-8905-846844f9a8d9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:49.412672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 62/127] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:20:49 2022] GET /identity/v3/role_assignments?user.id=28d5854b2bc04ea7a32ebadc709ee034&scope.project.id=a169391a6f324e26a7a0b1278ba35a09&role.id=d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:49.414101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aeade-c1c5-433f-8905-846844f9a8d9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:49.474571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0e90-9255-42e4-97ca-1bd051c5681e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:49.483430 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:49.517504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fb7ad-854c-4122-8b87-c95bcafb8094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:49.517504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb7ad-854c-4122-8b87-c95bcafb8094 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:49.517795 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb7ad-854c-4122-8b87-c95bcafb8094 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:49.518027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb7ad-854c-4122-8b87-c95bcafb8094 None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09/users/5c48b55fbaa44be0a599a1b824d2c948/roles/89fe31f4d186444ba9cb0a45fed64ae7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:49.520180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fb7ad-854c-4122-8b87-c95bcafb8094 None admin] RBAC: Authorizing `identity:create_grant(project_id=a169391a6f324e26a7a0b1278ba35a09, user_id=5c48b55fbaa44be0a599a1b824d2c948, role_id=89fe31f4d186444ba9cb0a45fed64ae7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:49.522062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fb7ad-854c-4122-8b87-c95bcafb8094 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:49.544286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 66/128] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:20:49 2022] PUT /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09/users/5c48b55fbaa44be0a599a1b824d2c948/roles/89fe31f4d186444ba9cb0a45fed64ae7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:20:49.565294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aeade-c1c5-433f-8905-846844f9a8d9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:49.607794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72c27c-3216-4b3a-814d-99bbe6317267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:49.608499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c27c-3216-4b3a-814d-99bbe6317267 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:49.608850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c27c-3216-4b3a-814d-99bbe6317267 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:49.609175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72c27c-3216-4b3a-814d-99bbe6317267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:49.609979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72c27c-3216-4b3a-814d-99bbe6317267 None admin] RBAC: Adding query filter params (role.id=f36bf60d6adc430cb9cd4b01f399fa18, scope.project.id=ee804baf83614987b264d2a6654d296d, user.id=28d5854b2bc04ea7a32ebadc709ee034) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:49.610293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72c27c-3216-4b3a-814d-99bbe6317267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:49.611852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72c27c-3216-4b3a-814d-99bbe6317267 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:49.618818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 63/129] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:20:49 2022] GET /identity/v3/role_assignments?user.id=28d5854b2bc04ea7a32ebadc709ee034&scope.project.id=ee804baf83614987b264d2a6654d296d&role.id=f36bf60d6adc430cb9cd4b01f399fa18 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:51.095842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f7e2-fd45-492a-8376-07577fc5bd07 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:51.096322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f7e2-fd45-492a-8376-07577fc5bd07 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:51.096400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f7e2-fd45-492a-8376-07577fc5bd07 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:51.097765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 67/130] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:51.102967 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac39f-7881-4961-944d-bad444f30007 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:51.103368 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac39f-7881-4961-944d-bad444f30007 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:51.103517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac39f-7881-4961-944d-bad444f30007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:51.122876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-599ac39f-7881-4961-944d-bad444f30007 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:51.124065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-599ac39f-7881-4961-944d-bad444f30007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:51.173994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:51.190649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 64/131] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:51.458425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7f7e2-fd45-492a-8376-07577fc5bd07 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:51.558539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7f7e2-fd45-492a-8376-07577fc5bd07 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:51.591968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4e25b-1337-45c5-9b6f-faa8975c1ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:51.592619 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e25b-1337-45c5-9b6f-faa8975c1ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:51.592903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e25b-1337-45c5-9b6f-faa8975c1ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:51.593176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e25b-1337-45c5-9b6f-faa8975c1ad5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:51.594255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4e25b-1337-45c5-9b6f-faa8975c1ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:51.595705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4e25b-1337-45c5-9b6f-faa8975c1ad5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:51.597299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 68/132] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:51.602881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac39f-7881-4961-944d-bad444f30007 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:51.703026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac39f-7881-4961-944d-bad444f30007 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:51.729712 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c77fcc-d3f9-4d13-b6a0-52276ab6309d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:51.729928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c77fcc-d3f9-4d13-b6a0-52276ab6309d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:51.730194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c77fcc-d3f9-4d13-b6a0-52276ab6309d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:51.732082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 69/133] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:51.736660 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ddc26-79fe-4c46-ad29-4fb1df9b980b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:51.737014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ddc26-79fe-4c46-ad29-4fb1df9b980b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:51.737222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008eef4-7dfd-4163-9787-146bffb8a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:51.737414 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ddc26-79fe-4c46-ad29-4fb1df9b980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:51.737834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008eef4-7dfd-4163-9787-146bffb8a6b7 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:51.738121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008eef4-7dfd-4163-9787-146bffb8a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:51.738395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008eef4-7dfd-4163-9787-146bffb8a6b7 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:51.739035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008eef4-7dfd-4163-9787-146bffb8a6b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:51.740473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008eef4-7dfd-4163-9787-146bffb8a6b7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:51.756415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c11ddc26-79fe-4c46-ad29-4fb1df9b980b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:51.757857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c11ddc26-79fe-4c46-ad29-4fb1df9b980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:51.762887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 65/134] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:20:51 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:20:51.787375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:51.832945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 70/135] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:20:52.101897 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008eef4-7dfd-4163-9787-146bffb8a6b7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:52.150456 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:52.217134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008eef4-7dfd-4163-9787-146bffb8a6b7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:52.253691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48765db-a668-4bc4-9793-51ee46acc964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:52.254330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48765db-a668-4bc4-9793-51ee46acc964 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:52.254616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48765db-a668-4bc4-9793-51ee46acc964 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:52.254947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48765db-a668-4bc4-9793-51ee46acc964 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:52.266254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48765db-a668-4bc4-9793-51ee46acc964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a48765db-a668-4bc4-9793-51ee46acc964 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:52.271653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:52.272513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:52.273343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 66/136] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:52.280169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ddc26-79fe-4c46-ad29-4fb1df9b980b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:52.386868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ddc26-79fe-4c46-ad29-4fb1df9b980b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:52.423688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b33a3-e155-4688-b82a-a65faecfc5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:52.424299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b33a3-e155-4688-b82a-a65faecfc5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:52.424612 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b33a3-e155-4688-b82a-a65faecfc5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:52.424888 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b33a3-e155-4688-b82a-a65faecfc5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:52.425555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b33a3-e155-4688-b82a-a65faecfc5b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:52.425859 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b33a3-e155-4688-b82a-a65faecfc5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:52.427301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b33a3-e155-4688-b82a-a65faecfc5b8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:52.436256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 71/137] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:20:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:52.442353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48765db-a668-4bc4-9793-51ee46acc964 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:52.547332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48765db-a668-4bc4-9793-51ee46acc964 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:52.548972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:52.583435 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79baba7-2a63-4eb8-b548-b97407b718ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:52.584122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79baba7-2a63-4eb8-b548-b97407b718ef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:52.584409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79baba7-2a63-4eb8-b548-b97407b718ef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:52.584713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79baba7-2a63-4eb8-b548-b97407b718ef None admin] PATH_INFO: `/v3/users/5c48b55fbaa44be0a599a1b824d2c948` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:52.585911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79baba7-2a63-4eb8-b548-b97407b718ef None admin] RBAC: Authorizing `identity:get_user(user_id=5c48b55fbaa44be0a599a1b824d2c948)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:52.587344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79baba7-2a63-4eb8-b548-b97407b718ef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:52.589022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 67/138] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:52 2022] GET /identity/v3/users/5c48b55fbaa44be0a599a1b824d2c948 => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:52.594782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b33a3-e155-4688-b82a-a65faecfc5b8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:52.624119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:52.707702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b33a3-e155-4688-b82a-a65faecfc5b8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:52.747959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ba27c-306a-443c-a5ed-e7fd707cec2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:52.748661 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ba27c-306a-443c-a5ed-e7fd707cec2e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:52.748946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ba27c-306a-443c-a5ed-e7fd707cec2e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:52.749280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ba27c-306a-443c-a5ed-e7fd707cec2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:52.822722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ba27c-306a-443c-a5ed-e7fd707cec2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:52.824884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ba27c-306a-443c-a5ed-e7fd707cec2e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:52.852078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:52.928778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 72/139] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:20:52.939010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79baba7-2a63-4eb8-b548-b97407b718ef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:53.051439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79baba7-2a63-4eb8-b548-b97407b718ef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:53.087458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09366db6-78fc-445f-ad3a-8aecf5815090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:53.088096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366db6-78fc-445f-ad3a-8aecf5815090 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:53.088376 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366db6-78fc-445f-ad3a-8aecf5815090 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:53.088679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366db6-78fc-445f-ad3a-8aecf5815090 None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:53.089916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09366db6-78fc-445f-ad3a-8aecf5815090 None admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:53.091462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09366db6-78fc-445f-ad3a-8aecf5815090 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:53.093338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 68/140] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:52 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:53.099156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ba27c-306a-443c-a5ed-e7fd707cec2e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:53.202728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ba27c-306a-443c-a5ed-e7fd707cec2e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:53.229325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:53.239806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45ec1b-cde6-4571-adba-3fb49b51c2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:53.240416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45ec1b-cde6-4571-adba-3fb49b51c2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:53.240977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45ec1b-cde6-4571-adba-3fb49b51c2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:53.241251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45ec1b-cde6-4571-adba-3fb49b51c2a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:53.241968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45ec1b-cde6-4571-adba-3fb49b51c2a7 None admin] RBAC: Adding query filter params (role.id=89fe31f4d186444ba9cb0a45fed64ae7, scope.project.id=a169391a6f324e26a7a0b1278ba35a09, user.id=5c48b55fbaa44be0a599a1b824d2c948) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:53.242272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45ec1b-cde6-4571-adba-3fb49b51c2a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:53.243703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45ec1b-cde6-4571-adba-3fb49b51c2a7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:53.250108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 73/141] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:20:53 2022] GET /identity/v3/role_assignments?user.id=5c48b55fbaa44be0a599a1b824d2c948&scope.project.id=a169391a6f324e26a7a0b1278ba35a09&role.id=89fe31f4d186444ba9cb0a45fed64ae7 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:54.015954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e035fc-00ea-42a9-90f6-752fa9c9eb78 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.016483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e035fc-00ea-42a9-90f6-752fa9c9eb78 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.016558 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e035fc-00ea-42a9-90f6-752fa9c9eb78 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.018840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 69/142] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:54.023787 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f962eb-e210-4a8a-bef0-36200683aa18 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.024187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f962eb-e210-4a8a-bef0-36200683aa18 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.024341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f962eb-e210-4a8a-bef0-36200683aa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.046723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-24f962eb-e210-4a8a-bef0-36200683aa18 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:54.047907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-24f962eb-e210-4a8a-bef0-36200683aa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:54.116415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 74/143] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:54.250569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0b31-00a4-4c39-b716-abf2728d91a6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.250856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0b31-00a4-4c39-b716-abf2728d91a6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.251294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0b31-00a4-4c39-b716-abf2728d91a6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.252797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 70/144] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:54.257718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460d982-a31f-407d-b93c-d7ad71415cd1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.258002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460d982-a31f-407d-b93c-d7ad71415cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.258273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460d982-a31f-407d-b93c-d7ad71415cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.277980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c460d982-a31f-407d-b93c-d7ad71415cd1 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:54.278795 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c460d982-a31f-407d-b93c-d7ad71415cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:54.301640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dac27-528f-402d-978a-7fc68a0388c6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.302185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dac27-528f-402d-978a-7fc68a0388c6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.302468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dac27-528f-402d-978a-7fc68a0388c6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.303787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 71/145] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:54.309816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0c59d-baa4-4ba6-bcb9-318a62a08154 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.310260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0c59d-baa4-4ba6-bcb9-318a62a08154 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.310547 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0c59d-baa4-4ba6-bcb9-318a62a08154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.328808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1fb0c59d-baa4-4ba6-bcb9-318a62a08154 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:54.330003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1fb0c59d-baa4-4ba6-bcb9-318a62a08154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:54.358979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 75/146] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:54.362372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:54.385293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460d982-a31f-407d-b93c-d7ad71415cd1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:54.404354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 72/147] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:20:54.445825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:54.498961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460d982-a31f-407d-b93c-d7ad71415cd1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:54.534288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31cbd8-6d14-4c3b-99dc-15a6903a8dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:54.534849 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31cbd8-6d14-4c3b-99dc-15a6903a8dae None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.535135 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31cbd8-6d14-4c3b-99dc-15a6903a8dae None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.535472 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31cbd8-6d14-4c3b-99dc-15a6903a8dae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.546584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31cbd8-6d14-4c3b-99dc-15a6903a8dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-af31cbd8-6d14-4c3b-99dc-15a6903a8dae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:54.551491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:54.552318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:20:54.553230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 76/148] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:20:54.561272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0c59d-baa4-4ba6-bcb9-318a62a08154 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:54.628347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31cbd8-6d14-4c3b-99dc-15a6903a8dae None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:54.664530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0c59d-baa4-4ba6-bcb9-318a62a08154 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:54.700613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96160098-3ca4-4db2-abe1-0f3647f379d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:54.701247 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160098-3ca4-4db2-abe1-0f3647f379d3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.701528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160098-3ca4-4db2-abe1-0f3647f379d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.701800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160098-3ca4-4db2-abe1-0f3647f379d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.702462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96160098-3ca4-4db2-abe1-0f3647f379d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:54.702770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96160098-3ca4-4db2-abe1-0f3647f379d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:54.704130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96160098-3ca4-4db2-abe1-0f3647f379d3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:54.712028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 73/149] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:54.717444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96160098-3ca4-4db2-abe1-0f3647f379d3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:54.731149 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31cbd8-6d14-4c3b-99dc-15a6903a8dae None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:54.742115 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:54.753111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:54.768117 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a9666-330c-4e2d-9619-476f865dfb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:54.768776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a9666-330c-4e2d-9619-476f865dfb7d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.769067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a9666-330c-4e2d-9619-476f865dfb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.769333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a9666-330c-4e2d-9619-476f865dfb7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.779747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a9666-330c-4e2d-9619-476f865dfb7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b14a9666-330c-4e2d-9619-476f865dfb7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:54.784721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:54.785567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:20:54.786334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 77/150] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:20:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:20:54.787054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a9666-330c-4e2d-9619-476f865dfb7d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:54.827911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96160098-3ca4-4db2-abe1-0f3647f379d3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:54.861040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497d579-048d-469c-9a48-e8d1e0c8fc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:54.861670 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497d579-048d-469c-9a48-e8d1e0c8fc29 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.861953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497d579-048d-469c-9a48-e8d1e0c8fc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.862228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497d579-048d-469c-9a48-e8d1e0c8fc29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.863331 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497d579-048d-469c-9a48-e8d1e0c8fc29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:54.864794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497d579-048d-469c-9a48-e8d1e0c8fc29 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:54.866591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 74/151] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:54.872025 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497d579-048d-469c-9a48-e8d1e0c8fc29 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:54.888574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a9666-330c-4e2d-9619-476f865dfb7d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:54.921552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803ae94-9599-48d8-b35a-8d7d9046c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:54.922176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803ae94-9599-48d8-b35a-8d7d9046c557 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:54.922453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803ae94-9599-48d8-b35a-8d7d9046c557 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:54.922726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803ae94-9599-48d8-b35a-8d7d9046c557 None admin] PATH_INFO: `/v3/users/0487a6130ba34f3fa0cda439e01cfeb2` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:54.935942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803ae94-9599-48d8-b35a-8d7d9046c557 None admin] RBAC: Authorizing `identity:get_user(user_id=0487a6130ba34f3fa0cda439e01cfeb2)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:54.937464 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803ae94-9599-48d8-b35a-8d7d9046c557 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:54.939048 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 78/152] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:54 2022] GET /identity/v3/users/0487a6130ba34f3fa0cda439e01cfeb2 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:54.939790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803ae94-9599-48d8-b35a-8d7d9046c557 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:54.965618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:54.967635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:54.969819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497d579-048d-469c-9a48-e8d1e0c8fc29 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:55.003795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5ae44-e9e7-4e79-a671-4f414b828ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:55.004405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5ae44-e9e7-4e79-a671-4f414b828ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:55.004722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5ae44-e9e7-4e79-a671-4f414b828ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:55.005001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5ae44-e9e7-4e79-a671-4f414b828ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:55.005662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5ae44-e9e7-4e79-a671-4f414b828ae9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:55.005968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5ae44-e9e7-4e79-a671-4f414b828ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:55.007333 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5ae44-e9e7-4e79-a671-4f414b828ae9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:55.015294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 75/153] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:20:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:55.016080 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5ae44-e9e7-4e79-a671-4f414b828ae9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:55.041891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803ae94-9599-48d8-b35a-8d7d9046c557 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:55.075684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099ebb8-cf85-4d7c-9ab4-6a555e896068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:55.076300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099ebb8-cf85-4d7c-9ab4-6a555e896068 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:55.076614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099ebb8-cf85-4d7c-9ab4-6a555e896068 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:55.076891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099ebb8-cf85-4d7c-9ab4-6a555e896068 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:55.077532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099ebb8-cf85-4d7c-9ab4-6a555e896068 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:55.078987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099ebb8-cf85-4d7c-9ab4-6a555e896068 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:55.100479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 79/154] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:20:54 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:20:55.101315 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099ebb8-cf85-4d7c-9ab4-6a555e896068 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:55.127548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5ae44-e9e7-4e79-a671-4f414b828ae9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:55.165261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee4063-7aeb-484e-b1be-21e82b5edd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:55.165931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee4063-7aeb-484e-b1be-21e82b5edd07 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:55.166283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee4063-7aeb-484e-b1be-21e82b5edd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:55.166570 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee4063-7aeb-484e-b1be-21e82b5edd07 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:55.168158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee4063-7aeb-484e-b1be-21e82b5edd07 None admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:55.169737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee4063-7aeb-484e-b1be-21e82b5edd07 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:55.171597 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 76/155] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:55 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:55.177387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee4063-7aeb-484e-b1be-21e82b5edd07 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:55.207324 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:55.214213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:55.225368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099ebb8-cf85-4d7c-9ab4-6a555e896068 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:55.263733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892f3f-d378-4377-8c83-b624aefdbd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:55.264413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892f3f-d378-4377-8c83-b624aefdbd8d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:55.264726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892f3f-d378-4377-8c83-b624aefdbd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:55.265670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892f3f-d378-4377-8c83-b624aefdbd8d None admin] PATH_INFO: `/v3/users/0487a6130ba34f3fa0cda439e01cfeb2` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:55.266175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c892f3f-d378-4377-8c83-b624aefdbd8d None admin] RBAC: Authorizing `identity:get_user(user_id=0487a6130ba34f3fa0cda439e01cfeb2)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:55.267637 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c892f3f-d378-4377-8c83-b624aefdbd8d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:55.269507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 80/156] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:55 2022] GET /identity/v3/users/0487a6130ba34f3fa0cda439e01cfeb2 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:55.275018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892f3f-d378-4377-8c83-b624aefdbd8d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:55.301670 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee4063-7aeb-484e-b1be-21e82b5edd07 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:55.345586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609d23a-3029-4228-bb59-4165d57185e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:55.346259 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609d23a-3029-4228-bb59-4165d57185e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:55.346545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609d23a-3029-4228-bb59-4165d57185e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:55.346904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609d23a-3029-4228-bb59-4165d57185e8 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/users/0487a6130ba34f3fa0cda439e01cfeb2/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:55.348933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609d23a-3029-4228-bb59-4165d57185e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ab9b9969c94aa28422c81ea6f32a2b, user_id=0487a6130ba34f3fa0cda439e01cfeb2, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:55.351113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609d23a-3029-4228-bb59-4165d57185e8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:55.368769 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 77/157] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:20:55 2022] PUT /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/users/0487a6130ba34f3fa0cda439e01cfeb2/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:20:55.397040 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892f3f-d378-4377-8c83-b624aefdbd8d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:55.442368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc997c92-800a-4345-a6df-0fd5ce9e6aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:55.443028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997c92-800a-4345-a6df-0fd5ce9e6aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:55.443304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997c92-800a-4345-a6df-0fd5ce9e6aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:55.443577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997c92-800a-4345-a6df-0fd5ce9e6aa4 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:55.444837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc997c92-800a-4345-a6df-0fd5ce9e6aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:55.446328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc997c92-800a-4345-a6df-0fd5ce9e6aa4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:55.448212 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 81/158] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:55 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:20:55.455125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609d23a-3029-4228-bb59-4165d57185e8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:55.565277 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:55.579922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609d23a-3029-4228-bb59-4165d57185e8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:55.618220 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06e958-736a-4da0-9860-a7298dfbe33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:55.618887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06e958-736a-4da0-9860-a7298dfbe33f None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:55.619169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06e958-736a-4da0-9860-a7298dfbe33f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:55.619446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06e958-736a-4da0-9860-a7298dfbe33f None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/users/0487a6130ba34f3fa0cda439e01cfeb2/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:55.622356 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06e958-736a-4da0-9860-a7298dfbe33f None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ab9b9969c94aa28422c81ea6f32a2b, user_id=0487a6130ba34f3fa0cda439e01cfeb2, role_id=d36d8bd9f47e4ea8bef7f96d37d55d3c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:55.623800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06e958-736a-4da0-9860-a7298dfbe33f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:55.638714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 78/159] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:20:55 2022] PUT /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/users/0487a6130ba34f3fa0cda439e01cfeb2/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:20:57.411852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e70ab-656f-46b1-9102-d7b685aca57a None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:57.412379 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e70ab-656f-46b1-9102-d7b685aca57a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:57.412379 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e70ab-656f-46b1-9102-d7b685aca57a None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:57.413693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 82/160] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:57.419503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff1a3-c3fe-4e7b-890c-b51d05f9a6e6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:57.419975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff1a3-c3fe-4e7b-890c-b51d05f9a6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:57.420056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff1a3-c3fe-4e7b-890c-b51d05f9a6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:57.440433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2ceff1a3-c3fe-4e7b-890c-b51d05f9a6e6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:57.441899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2ceff1a3-c3fe-4e7b-890c-b51d05f9a6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:57.517236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 79/161] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:57.574646 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfd35-6524-421f-a44f-770064af548b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:57.574973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfd35-6524-421f-a44f-770064af548b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:57.575197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfd35-6524-421f-a44f-770064af548b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:57.576806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 83/162] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:57.582116 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c184d-9f84-4dfc-8505-0de8c9226dd9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:57.582523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c184d-9f84-4dfc-8505-0de8c9226dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:57.582935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c184d-9f84-4dfc-8505-0de8c9226dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:57.601187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6d6c184d-9f84-4dfc-8505-0de8c9226dd9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:57.602405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6d6c184d-9f84-4dfc-8505-0de8c9226dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:57.615026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db68b0-c4a0-408e-8fd0-406b95eef997 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:57.615318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db68b0-c4a0-408e-8fd0-406b95eef997 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:57.615863 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db68b0-c4a0-408e-8fd0-406b95eef997 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:57.617371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 84/163] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:20:57.622764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2939e-9ba6-4200-a03a-3568687fd751 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:57.623054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2939e-9ba6-4200-a03a-3568687fd751 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:57.623334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2939e-9ba6-4200-a03a-3568687fd751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:57.642220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-76f2939e-9ba6-4200-a03a-3568687fd751 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:57.643418 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-76f2939e-9ba6-4200-a03a-3568687fd751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:57.660983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:57.686606 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 80/164] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:20:57.723155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 85/165] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:20:57.817931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c184d-9f84-4dfc-8505-0de8c9226dd9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:57.829902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe78ee-95be-4f3e-a34d-cdc2c7e42696 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:57.830178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe78ee-95be-4f3e-a34d-cdc2c7e42696 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:57.830454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe78ee-95be-4f3e-a34d-cdc2c7e42696 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:57.830988 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:57.832042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 86/166] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:20:57.837264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833accad-9566-4c31-a53e-687f100290ef None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:57.837566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833accad-9566-4c31-a53e-687f100290ef None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:57.838135 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833accad-9566-4c31-a53e-687f100290ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:57.856950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-833accad-9566-4c31-a53e-687f100290ef None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:20:57.858125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-833accad-9566-4c31-a53e-687f100290ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:20:57.928031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c184d-9f84-4dfc-8505-0de8c9226dd9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:57.948229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 87/167] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:20:57.958653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833accad-9566-4c31-a53e-687f100290ef None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:57.968081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb220e46-f282-42e2-9a41-d80f290c2142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:57.969091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb220e46-f282-42e2-9a41-d80f290c2142 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:57.969623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb220e46-f282-42e2-9a41-d80f290c2142 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:57.970092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb220e46-f282-42e2-9a41-d80f290c2142 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:57.981790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb220e46-f282-42e2-9a41-d80f290c2142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fb220e46-f282-42e2-9a41-d80f290c2142 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:57.987235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:57.988115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:20:57.989077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:57.991585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 81/168] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:57.997950 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb220e46-f282-42e2-9a41-d80f290c2142 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.047292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:58.072508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:58.074455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833accad-9566-4c31-a53e-687f100290ef None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:58.110001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb220e46-f282-42e2-9a41-d80f290c2142 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:58.110866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097abf11-928a-411c-a406-a79b1c60e7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:58.111595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097abf11-928a-411c-a406-a79b1c60e7aa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:58.111942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097abf11-928a-411c-a406-a79b1c60e7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:58.112493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097abf11-928a-411c-a406-a79b1c60e7aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:58.113674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097abf11-928a-411c-a406-a79b1c60e7aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:58.115165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097abf11-928a-411c-a406-a79b1c60e7aa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:58.121103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 88/169] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:20:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:20:58.121103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097abf11-928a-411c-a406-a79b1c60e7aa None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.150795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18328-dac5-414a-9afa-49170439775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:58.151937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18328-dac5-414a-9afa-49170439775a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:58.152403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18328-dac5-414a-9afa-49170439775a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:58.152709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18328-dac5-414a-9afa-49170439775a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:58.153375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e18328-dac5-414a-9afa-49170439775a None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:58.153680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e18328-dac5-414a-9afa-49170439775a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:58.155538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e18328-dac5-414a-9afa-49170439775a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:58.163744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 82/170] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:20:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:20:58.164537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18328-dac5-414a-9afa-49170439775a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.240934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097abf11-928a-411c-a406-a79b1c60e7aa None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:58.273763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18328-dac5-414a-9afa-49170439775a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:58.274988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed2ccf-2f86-4a11-b3bc-a7d316e81ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:58.275607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed2ccf-2f86-4a11-b3bc-a7d316e81ffb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:58.275884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed2ccf-2f86-4a11-b3bc-a7d316e81ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:58.276148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed2ccf-2f86-4a11-b3bc-a7d316e81ffb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:58.286492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed2ccf-2f86-4a11-b3bc-a7d316e81ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-c4ed2ccf-2f86-4a11-b3bc-a7d316e81ffb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:58.292539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:58.293447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 89/171] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:58.294839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed2ccf-2f86-4a11-b3bc-a7d316e81ffb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.305012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:58.306830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:58.312614 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f42fc-bccc-48ba-9fd4-b0a018911742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:58.313258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f42fc-bccc-48ba-9fd4-b0a018911742 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:58.313538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f42fc-bccc-48ba-9fd4-b0a018911742 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:58.313814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f42fc-bccc-48ba-9fd4-b0a018911742 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:58.314524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f42fc-bccc-48ba-9fd4-b0a018911742 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:58.315957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f42fc-bccc-48ba-9fd4-b0a018911742 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:58.336352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 83/172] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:20:58 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:20:58.337178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f42fc-bccc-48ba-9fd4-b0a018911742 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.418280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed2ccf-2f86-4a11-b3bc-a7d316e81ffb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:58.454885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f42fc-bccc-48ba-9fd4-b0a018911742 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:58.455451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ab64-b449-45dc-ba79-a5de9dbfb426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:58.455904 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ab64-b449-45dc-ba79-a5de9dbfb426 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:58.456183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ab64-b449-45dc-ba79-a5de9dbfb426 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:58.456487 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ab64-b449-45dc-ba79-a5de9dbfb426 None admin] PATH_INFO: `/v3/users/280ae4b07a5d432990534e6372e89ff8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:58.471340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597ab64-b449-45dc-ba79-a5de9dbfb426 None admin] RBAC: Authorizing `identity:get_user(user_id=280ae4b07a5d432990534e6372e89ff8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:58.472883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597ab64-b449-45dc-ba79-a5de9dbfb426 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:58.474579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 90/173] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:58 2022] GET /identity/v3/users/280ae4b07a5d432990534e6372e89ff8 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:58.480678 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ab64-b449-45dc-ba79-a5de9dbfb426 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.499029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be25e7-959a-4a6c-b9fe-352df0edd7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:58.500118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be25e7-959a-4a6c-b9fe-352df0edd7ab None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:58.500873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be25e7-959a-4a6c-b9fe-352df0edd7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:58.501152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be25e7-959a-4a6c-b9fe-352df0edd7ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:58.514291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be25e7-959a-4a6c-b9fe-352df0edd7ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-56be25e7-959a-4a6c-b9fe-352df0edd7ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:20:58.519679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:20:58.520751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 84/174] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:20:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:20:58.526473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be25e7-959a-4a6c-b9fe-352df0edd7ab None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.560865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:58.583076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:58.601069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ab64-b449-45dc-ba79-a5de9dbfb426 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:58.644775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758134e-f36d-49bd-bd6b-73a7f5048e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:58.645701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758134e-f36d-49bd-bd6b-73a7f5048e22 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:58.646133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758134e-f36d-49bd-bd6b-73a7f5048e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:58.646566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758134e-f36d-49bd-bd6b-73a7f5048e22 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:58.648056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758134e-f36d-49bd-bd6b-73a7f5048e22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:58.648543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758134e-f36d-49bd-bd6b-73a7f5048e22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:58.650155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758134e-f36d-49bd-bd6b-73a7f5048e22 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:58.660999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 91/175] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:20:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:58.662045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758134e-f36d-49bd-bd6b-73a7f5048e22 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.664180 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be25e7-959a-4a6c-b9fe-352df0edd7ab None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:58.706857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378417d-4b40-448c-a583-53d1f9a4afe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:58.707751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378417d-4b40-448c-a583-53d1f9a4afe7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:58.708168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378417d-4b40-448c-a583-53d1f9a4afe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:58.708627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378417d-4b40-448c-a583-53d1f9a4afe7 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:58.709906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378417d-4b40-448c-a583-53d1f9a4afe7 None admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:58.712315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378417d-4b40-448c-a583-53d1f9a4afe7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:58.714647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 85/176] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:58 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:58.715861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378417d-4b40-448c-a583-53d1f9a4afe7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.793752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758134e-f36d-49bd-bd6b-73a7f5048e22 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:58.830919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:58.842164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9ca5-82f2-43fb-90a6-862be816ba65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:58.843241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9ca5-82f2-43fb-90a6-862be816ba65 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:58.843917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9ca5-82f2-43fb-90a6-862be816ba65 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:58.844345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9ca5-82f2-43fb-90a6-862be816ba65 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:58.845788 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf9ca5-82f2-43fb-90a6-862be816ba65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:20:58.846235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf9ca5-82f2-43fb-90a6-862be816ba65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:58.847439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378417d-4b40-448c-a583-53d1f9a4afe7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:58.847911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf9ca5-82f2-43fb-90a6-862be816ba65 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:58.859433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 92/177] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:20:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:58.860883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9ca5-82f2-43fb-90a6-862be816ba65 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.864929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:58.895633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512e13a-bf96-4ce7-8880-3a3baf875338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:58.896274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e13a-bf96-4ce7-8880-3a3baf875338 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:58.896589 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e13a-bf96-4ce7-8880-3a3baf875338 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:58.896869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e13a-bf96-4ce7-8880-3a3baf875338 None admin] PATH_INFO: `/v3/users/0487a6130ba34f3fa0cda439e01cfeb2` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:58.898079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512e13a-bf96-4ce7-8880-3a3baf875338 None admin] RBAC: Authorizing `identity:get_user(user_id=0487a6130ba34f3fa0cda439e01cfeb2)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:58.899689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512e13a-bf96-4ce7-8880-3a3baf875338 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:58.903326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 86/178] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:58 2022] GET /identity/v3/users/0487a6130ba34f3fa0cda439e01cfeb2 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:58.908790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512e13a-bf96-4ce7-8880-3a3baf875338 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:58.997019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9ca5-82f2-43fb-90a6-862be816ba65 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:59.033170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512e13a-bf96-4ce7-8880-3a3baf875338 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:59.051324 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ddc43-220a-48d9-8ddd-536282a5248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:59.052291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ddc43-220a-48d9-8ddd-536282a5248c None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:59.052732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ddc43-220a-48d9-8ddd-536282a5248c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:59.053143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ddc43-220a-48d9-8ddd-536282a5248c None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/users/280ae4b07a5d432990534e6372e89ff8/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:59.055772 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ddc43-220a-48d9-8ddd-536282a5248c None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ab9b9969c94aa28422c81ea6f32a2b, user_id=280ae4b07a5d432990534e6372e89ff8, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:59.057459 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ddc43-220a-48d9-8ddd-536282a5248c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:59.076765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 93/179] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:20:58 2022] PUT /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/users/280ae4b07a5d432990534e6372e89ff8/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:20:59.081754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ddc43-220a-48d9-8ddd-536282a5248c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:59.092780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38115e-16d5-4f7e-bfc7-122701bfd469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:59.093453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38115e-16d5-4f7e-bfc7-122701bfd469 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:59.095286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38115e-16d5-4f7e-bfc7-122701bfd469 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:59.095579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38115e-16d5-4f7e-bfc7-122701bfd469 None admin] PATH_INFO: `/v3/users/0487a6130ba34f3fa0cda439e01cfeb2` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:59.097331 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38115e-16d5-4f7e-bfc7-122701bfd469 None admin] RBAC: Authorizing `identity:get_user(user_id=0487a6130ba34f3fa0cda439e01cfeb2)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:59.100901 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38115e-16d5-4f7e-bfc7-122701bfd469 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:59.103895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 87/180] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:20:58 2022] GET /identity/v3/users/0487a6130ba34f3fa0cda439e01cfeb2 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:20:59.112929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38115e-16d5-4f7e-bfc7-122701bfd469 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:59.195378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:59.216426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:59.289880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ddc43-220a-48d9-8ddd-536282a5248c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:59.318722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38115e-16d5-4f7e-bfc7-122701bfd469 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:59.330553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4512e3a-2fe2-4766-979c-905171f6f1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:59.331238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4512e3a-2fe2-4766-979c-905171f6f1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:59.331579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4512e3a-2fe2-4766-979c-905171f6f1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:59.331790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4512e3a-2fe2-4766-979c-905171f6f1d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:59.381045 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e5776-2c47-4992-ab02-6cec43a103ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:59.382151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5776-2c47-4992-ab02-6cec43a103ed None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:59.382151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5776-2c47-4992-ab02-6cec43a103ed None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:59.382427 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5776-2c47-4992-ab02-6cec43a103ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:59.415150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4512e3a-2fe2-4766-979c-905171f6f1d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:59.417311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4512e3a-2fe2-4766-979c-905171f6f1d8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:59.479234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e5776-2c47-4992-ab02-6cec43a103ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:59.481478 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e5776-2c47-4992-ab02-6cec43a103ed None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:59.506413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:59.565255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 94/181] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:20:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:20:59.572884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4512e3a-2fe2-4766-979c-905171f6f1d8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:59.590906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:59.680549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 88/182] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:20:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:20:59.686948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e5776-2c47-4992-ab02-6cec43a103ed None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:59.756376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4512e3a-2fe2-4766-979c-905171f6f1d8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:59.800936 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867faa2d-529a-4aea-b331-19b73c99ab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:59.801571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867faa2d-529a-4aea-b331-19b73c99ab44 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:59.801851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867faa2d-529a-4aea-b331-19b73c99ab44 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:59.802122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867faa2d-529a-4aea-b331-19b73c99ab44 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:59.805357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867faa2d-529a-4aea-b331-19b73c99ab44 None admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:59.806815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867faa2d-529a-4aea-b331-19b73c99ab44 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:59.811932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 95/183] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:59 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:20:59.820348 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867faa2d-529a-4aea-b331-19b73c99ab44 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:59.858862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:20:59.889584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e5776-2c47-4992-ab02-6cec43a103ed None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:20:59.961530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e472d-c51d-457d-b1f7-f04051a33586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:20:59.963339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e472d-c51d-457d-b1f7-f04051a33586 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:20:59.972875 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e472d-c51d-457d-b1f7-f04051a33586 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:20:59.973166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e472d-c51d-457d-b1f7-f04051a33586 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:20:59.974450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e472d-c51d-457d-b1f7-f04051a33586 None admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:20:59.975920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e472d-c51d-457d-b1f7-f04051a33586 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:20:59.977767 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 89/184] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:20:59 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:20:59.984755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e472d-c51d-457d-b1f7-f04051a33586 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:20:59.999199 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867faa2d-529a-4aea-b331-19b73c99ab44 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:00.007501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:00.050642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ab5c2-ed54-4795-89ab-513f7d661e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:00.051064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ab5c2-ed54-4795-89ab-513f7d661e2c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:00.051446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ab5c2-ed54-4795-89ab-513f7d661e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:00.051820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ab5c2-ed54-4795-89ab-513f7d661e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:00.052689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ab5c2-ed54-4795-89ab-513f7d661e2c None admin] RBAC: Adding query filter params (role.id=9a4fa7f48c24440cae54bb4ec26b5b49, scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b, user.id=0487a6130ba34f3fa0cda439e01cfeb2) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:00.053006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ab5c2-ed54-4795-89ab-513f7d661e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:00.059437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ab5c2-ed54-4795-89ab-513f7d661e2c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:00.066100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 96/185] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:20:59 2022] GET /identity/v3/role_assignments?user.id=0487a6130ba34f3fa0cda439e01cfeb2&scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b&role.id=9a4fa7f48c24440cae54bb4ec26b5b49 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:00.166981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e472d-c51d-457d-b1f7-f04051a33586 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:00.217691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a316d7e-11bd-41fc-814b-a1c62e65a868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:00.218309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316d7e-11bd-41fc-814b-a1c62e65a868 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:00.218594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316d7e-11bd-41fc-814b-a1c62e65a868 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:00.218979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316d7e-11bd-41fc-814b-a1c62e65a868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:00.219714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a316d7e-11bd-41fc-814b-a1c62e65a868 None admin] RBAC: Adding query filter params (role.id=d36d8bd9f47e4ea8bef7f96d37d55d3c, scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b, user.id=0487a6130ba34f3fa0cda439e01cfeb2) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:00.220026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a316d7e-11bd-41fc-814b-a1c62e65a868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:00.221781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a316d7e-11bd-41fc-814b-a1c62e65a868 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:00.228779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 90/186] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:20:59 2022] GET /identity/v3/role_assignments?user.id=0487a6130ba34f3fa0cda439e01cfeb2&scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b&role.id=d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:00.773209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78848fd7-a152-4db0-9a72-0114bef8da00 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:00.773752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78848fd7-a152-4db0-9a72-0114bef8da00 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:00.773752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78848fd7-a152-4db0-9a72-0114bef8da00 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:00.775122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 97/187] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:00.780510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ab45-ab59-47d4-8226-b0a0e19c914d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:00.780931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ab45-ab59-47d4-8226-b0a0e19c914d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:00.781109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ab45-ab59-47d4-8226-b0a0e19c914d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:00.799824 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b679ab45-ab59-47d4-8226-b0a0e19c914d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:00.801018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b679ab45-ab59-47d4-8226-b0a0e19c914d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:00.873416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 91/188] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:00.955830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17b39-b554-48ae-895c-bc1fa1039ab9 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:00.956175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17b39-b554-48ae-895c-bc1fa1039ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:00.956393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17b39-b554-48ae-895c-bc1fa1039ab9 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:00.957913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 98/189] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:00.962877 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2f089-0f22-4f47-a13b-b9c7a3a8ccde None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:00.963170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2f089-0f22-4f47-a13b-b9c7a3a8ccde None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:00.963448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2f089-0f22-4f47-a13b-b9c7a3a8ccde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:00.983251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aad2f089-0f22-4f47-a13b-b9c7a3a8ccde None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:00.984432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aad2f089-0f22-4f47-a13b-b9c7a3a8ccde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:00.992104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:01.065175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 92/190] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:01.142280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e17b39-b554-48ae-895c-bc1fa1039ab9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:01.230519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:01.251692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e17b39-b554-48ae-895c-bc1fa1039ab9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:01.285614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e51074-18c0-4d3d-bc12-0bada8996edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:01.286246 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e51074-18c0-4d3d-bc12-0bada8996edd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:01.286527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e51074-18c0-4d3d-bc12-0bada8996edd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:01.286810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e51074-18c0-4d3d-bc12-0bada8996edd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:01.297658 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e51074-18c0-4d3d-bc12-0bada8996edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a0e51074-18c0-4d3d-bc12-0bada8996edd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:01.302448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:01.303297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:01.304099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 99/191] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:01.310782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2f089-0f22-4f47-a13b-b9c7a3a8ccde None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:01.330580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e51074-18c0-4d3d-bc12-0bada8996edd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:01.418715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2f089-0f22-4f47-a13b-b9c7a3a8ccde None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:01.436271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e51074-18c0-4d3d-bc12-0bada8996edd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:01.456609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0c3d4-01c3-4c04-8d84-a2ec5a4dbf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:01.457243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0c3d4-01c3-4c04-8d84-a2ec5a4dbf91 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:01.457522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0c3d4-01c3-4c04-8d84-a2ec5a4dbf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:01.457794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0c3d4-01c3-4c04-8d84-a2ec5a4dbf91 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:01.458481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0c3d4-01c3-4c04-8d84-a2ec5a4dbf91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:01.458787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0c3d4-01c3-4c04-8d84-a2ec5a4dbf91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:01.460722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0c3d4-01c3-4c04-8d84-a2ec5a4dbf91 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:01.474709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 93/192] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:01.475790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0c3d4-01c3-4c04-8d84-a2ec5a4dbf91 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:01.480915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:01.481037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b601de-bf48-4cc8-80a2-943be30eaceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:01.481575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b601de-bf48-4cc8-80a2-943be30eaceb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:01.481857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b601de-bf48-4cc8-80a2-943be30eaceb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:01.482126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b601de-bf48-4cc8-80a2-943be30eaceb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:01.483254 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b601de-bf48-4cc8-80a2-943be30eaceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:01.484771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b601de-bf48-4cc8-80a2-943be30eaceb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:01.486332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 100/193] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:01.491858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b601de-bf48-4cc8-80a2-943be30eaceb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:01.505581 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:01.591666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0c3d4-01c3-4c04-8d84-a2ec5a4dbf91 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:01.596516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b601de-bf48-4cc8-80a2-943be30eaceb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:01.627697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80f508-31b1-4376-bb2a-eb03d95ae849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:01.628338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80f508-31b1-4376-bb2a-eb03d95ae849 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:01.628647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80f508-31b1-4376-bb2a-eb03d95ae849 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:01.628919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80f508-31b1-4376-bb2a-eb03d95ae849 None admin] PATH_INFO: `/v3/users/57a27005cb17400d8d8d5cb2bc5259c6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:01.631149 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082e0d9-f180-4b06-95f6-3836781019e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:01.631760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082e0d9-f180-4b06-95f6-3836781019e0 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:01.632044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082e0d9-f180-4b06-95f6-3836781019e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:01.632322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082e0d9-f180-4b06-95f6-3836781019e0 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:01.633000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082e0d9-f180-4b06-95f6-3836781019e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:01.634454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082e0d9-f180-4b06-95f6-3836781019e0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:01.643729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80f508-31b1-4376-bb2a-eb03d95ae849 None admin] RBAC: Authorizing `identity:get_user(user_id=57a27005cb17400d8d8d5cb2bc5259c6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:01.645288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80f508-31b1-4376-bb2a-eb03d95ae849 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:01.646955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 94/194] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:21:01 2022] GET /identity/v3/users/57a27005cb17400d8d8d5cb2bc5259c6 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:01.648503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ce44a-820b-44d5-b989-05308a25890d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:01.648963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ce44a-820b-44d5-b989-05308a25890d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:01.649316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ce44a-820b-44d5-b989-05308a25890d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:01.650579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 95/195] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:01.654109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ce44a-820b-44d5-b989-05308a25890d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:01.668020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 101/196] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:21:01 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:01.668020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b814-3d0c-4ce5-bc56-f80086dfd8ba None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:01.668020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b814-3d0c-4ce5-bc56-f80086dfd8ba None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:01.668020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b814-3d0c-4ce5-bc56-f80086dfd8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:01.685621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a332b814-3d0c-4ce5-bc56-f80086dfd8ba None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:01.687110 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a332b814-3d0c-4ce5-bc56-f80086dfd8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:01.727742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:01.757732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:01.766861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 102/197] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:01.779349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ce44a-820b-44d5-b989-05308a25890d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:01.817321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622a83a-c06f-49c5-bcc9-2aa269dd5150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:01.818150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a83a-c06f-49c5-bcc9-2aa269dd5150 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:01.818402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a83a-c06f-49c5-bcc9-2aa269dd5150 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:01.818741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a83a-c06f-49c5-bcc9-2aa269dd5150 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:01.820037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622a83a-c06f-49c5-bcc9-2aa269dd5150 None admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:01.821693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622a83a-c06f-49c5-bcc9-2aa269dd5150 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:01.824364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 96/198] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:21:01 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:01.829939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b814-3d0c-4ce5-bc56-f80086dfd8ba None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:01.937665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b814-3d0c-4ce5-bc56-f80086dfd8ba None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:01.975424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe2252-7a44-4f60-8430-89082d3a0eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:01.976092 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2252-7a44-4f60-8430-89082d3a0eea None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:01.976376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2252-7a44-4f60-8430-89082d3a0eea None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:01.976694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2252-7a44-4f60-8430-89082d3a0eea None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/users/57a27005cb17400d8d8d5cb2bc5259c6/roles/89fe31f4d186444ba9cb0a45fed64ae7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:01.978632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe2252-7a44-4f60-8430-89082d3a0eea None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ab9b9969c94aa28422c81ea6f32a2b, user_id=57a27005cb17400d8d8d5cb2bc5259c6, role_id=89fe31f4d186444ba9cb0a45fed64ae7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:01.980751 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe2252-7a44-4f60-8430-89082d3a0eea None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:01.998440 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 103/199] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:21:01 2022] PUT /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/users/57a27005cb17400d8d8d5cb2bc5259c6/roles/89fe31f4d186444ba9cb0a45fed64ae7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:02.039966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622a83a-c06f-49c5-bcc9-2aa269dd5150 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:02.161316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622a83a-c06f-49c5-bcc9-2aa269dd5150 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:02.195201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:02.204514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740225b-3f89-4597-a6f9-f9e26875ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:02.205304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740225b-3f89-4597-a6f9-f9e26875ec45 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:02.205499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740225b-3f89-4597-a6f9-f9e26875ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:02.205801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740225b-3f89-4597-a6f9-f9e26875ec45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:02.219914 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740225b-3f89-4597-a6f9-f9e26875ec45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0740225b-3f89-4597-a6f9-f9e26875ec45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:02.224907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:02.225762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:02.226524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 97/200] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:02.233307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe2252-7a44-4f60-8430-89082d3a0eea None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:02.297395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:02.345730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe2252-7a44-4f60-8430-89082d3a0eea None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:02.381625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fae3c3-3b92-4199-8c50-e467dd6dce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:02.382586 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fae3c3-3b92-4199-8c50-e467dd6dce72 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:02.383089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fae3c3-3b92-4199-8c50-e467dd6dce72 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:02.383563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fae3c3-3b92-4199-8c50-e467dd6dce72 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:02.384436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fae3c3-3b92-4199-8c50-e467dd6dce72 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:02.384962 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fae3c3-3b92-4199-8c50-e467dd6dce72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:02.386691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fae3c3-3b92-4199-8c50-e467dd6dce72 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:02.395657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 104/201] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:02.402155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740225b-3f89-4597-a6f9-f9e26875ec45 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:02.513333 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740225b-3f89-4597-a6f9-f9e26875ec45 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:02.552043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19daa5a-78d6-4fc1-8f43-e4c94fde3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:02.552768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daa5a-78d6-4fc1-8f43-e4c94fde3c13 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:02.553046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daa5a-78d6-4fc1-8f43-e4c94fde3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:02.553315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daa5a-78d6-4fc1-8f43-e4c94fde3c13 None admin] PATH_INFO: `/v3/users/280ae4b07a5d432990534e6372e89ff8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:02.554446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19daa5a-78d6-4fc1-8f43-e4c94fde3c13 None admin] RBAC: Authorizing `identity:get_user(user_id=280ae4b07a5d432990534e6372e89ff8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:02.555881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19daa5a-78d6-4fc1-8f43-e4c94fde3c13 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:02.558065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 98/202] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:21:02 2022] GET /identity/v3/users/280ae4b07a5d432990534e6372e89ff8 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:02.563833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fae3c3-3b92-4199-8c50-e467dd6dce72 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:02.671653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fae3c3-3b92-4199-8c50-e467dd6dce72 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:02.689059 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:02.706517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eb251-85db-40bc-aaf3-db94f7b6f7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:02.707196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eb251-85db-40bc-aaf3-db94f7b6f7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:02.707481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eb251-85db-40bc-aaf3-db94f7b6f7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:02.707750 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eb251-85db-40bc-aaf3-db94f7b6f7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:02.781515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eb251-85db-40bc-aaf3-db94f7b6f7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:02.782941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eb251-85db-40bc-aaf3-db94f7b6f7a1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:02.887990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 105/203] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:02.897528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19daa5a-78d6-4fc1-8f43-e4c94fde3c13 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:02.964281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:03.009142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19daa5a-78d6-4fc1-8f43-e4c94fde3c13 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:03.051794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085db06-4c82-4430-8c1b-9055b0d7ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:03.052438 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085db06-4c82-4430-8c1b-9055b0d7ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:03.052745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085db06-4c82-4430-8c1b-9055b0d7ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:03.053016 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085db06-4c82-4430-8c1b-9055b0d7ecb8 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:03.056557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085db06-4c82-4430-8c1b-9055b0d7ecb8 None admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:03.056557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085db06-4c82-4430-8c1b-9055b0d7ecb8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:03.057552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 99/204] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:21:02 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:03.063577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eb251-85db-40bc-aaf3-db94f7b6f7a1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:03.084918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:03.164207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eb251-85db-40bc-aaf3-db94f7b6f7a1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:03.198988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cb351-9b13-436e-bd68-ccdb970d430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:03.199643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cb351-9b13-436e-bd68-ccdb970d430b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:03.199923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cb351-9b13-436e-bd68-ccdb970d430b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:03.200190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cb351-9b13-436e-bd68-ccdb970d430b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:03.200995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cb351-9b13-436e-bd68-ccdb970d430b None admin] RBAC: Adding query filter params (role.id=f36bf60d6adc430cb9cd4b01f399fa18, scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b, user.id=280ae4b07a5d432990534e6372e89ff8) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:03.201301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cb351-9b13-436e-bd68-ccdb970d430b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:03.202742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cb351-9b13-436e-bd68-ccdb970d430b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:03.209062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 106/205] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:21:03 2022] GET /identity/v3/role_assignments?user.id=280ae4b07a5d432990534e6372e89ff8&scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b&role.id=f36bf60d6adc430cb9cd4b01f399fa18 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:04.058043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3871-a28e-4cb7-8923-529fa05965df None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.058548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3871-a28e-4cb7-8923-529fa05965df None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.058630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3871-a28e-4cb7-8923-529fa05965df None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.060068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 100/206] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:04.065166 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eab7af-647e-41dc-9de6-bbf01004b0de None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.065538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eab7af-647e-41dc-9de6-bbf01004b0de None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.065709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eab7af-647e-41dc-9de6-bbf01004b0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.084389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-31eab7af-647e-41dc-9de6-bbf01004b0de None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:04.085612 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-31eab7af-647e-41dc-9de6-bbf01004b0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:04.132868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8f238-7d7b-4251-a939-76e779da925f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.133146 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8f238-7d7b-4251-a939-76e779da925f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.133425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8f238-7d7b-4251-a939-76e779da925f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.134898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 101/207] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:21:04.140895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973521a-d38d-4a41-a5cf-a47ee71c9384 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.141188 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973521a-d38d-4a41-a5cf-a47ee71c9384 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.141463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973521a-d38d-4a41-a5cf-a47ee71c9384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.156526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 107/208] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:04.165437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c973521a-d38d-4a41-a5cf-a47ee71c9384 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:04.166762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c973521a-d38d-4a41-a5cf-a47ee71c9384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:04.238710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 102/209] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:21:04.269488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73dc0-d748-480e-a105-211cdefb87a1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.269771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73dc0-d748-480e-a105-211cdefb87a1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.270053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73dc0-d748-480e-a105-211cdefb87a1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.271541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 108/210] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:04.276529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e6d26-af69-4d58-8ad3-86c92dfd970e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.276821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e6d26-af69-4d58-8ad3-86c92dfd970e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.277091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e6d26-af69-4d58-8ad3-86c92dfd970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.295427 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cd3e6d26-af69-4d58-8ad3-86c92dfd970e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:04.296567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cd3e6d26-af69-4d58-8ad3-86c92dfd970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:04.345989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:04.364354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 103/211] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:04.425195 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73dc0-d748-480e-a105-211cdefb87a1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:04.440625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:04.514324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e6d26-af69-4d58-8ad3-86c92dfd970e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:04.531144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73dc0-d748-480e-a105-211cdefb87a1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:04.565195 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707322b-8d5e-47d0-a55b-adccd62caabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:04.565748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707322b-8d5e-47d0-a55b-adccd62caabf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.566027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707322b-8d5e-47d0-a55b-adccd62caabf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.566292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707322b-8d5e-47d0-a55b-adccd62caabf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.576990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707322b-8d5e-47d0-a55b-adccd62caabf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4707322b-8d5e-47d0-a55b-adccd62caabf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:04.581804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:04.582809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:04.583588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 109/212] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:04.588587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707322b-8d5e-47d0-a55b-adccd62caabf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:04.632891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e6d26-af69-4d58-8ad3-86c92dfd970e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:04.660363 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:04.667565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f55c56-a7f4-42e2-bd0a-4527b0738786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:04.668205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f55c56-a7f4-42e2-bd0a-4527b0738786 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.668505 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f55c56-a7f4-42e2-bd0a-4527b0738786 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.668782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f55c56-a7f4-42e2-bd0a-4527b0738786 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.669887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f55c56-a7f4-42e2-bd0a-4527b0738786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:04.671322 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f55c56-a7f4-42e2-bd0a-4527b0738786 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:04.672924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 104/213] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:04.676685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f55c56-a7f4-42e2-bd0a-4527b0738786 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:04.689902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707322b-8d5e-47d0-a55b-adccd62caabf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:04.723126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029712d-c8a7-4f34-9566-2cac5568f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:04.723723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029712d-c8a7-4f34-9566-2cac5568f45f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.724003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029712d-c8a7-4f34-9566-2cac5568f45f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.724273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029712d-c8a7-4f34-9566-2cac5568f45f None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.724957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029712d-c8a7-4f34-9566-2cac5568f45f None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:04.725256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029712d-c8a7-4f34-9566-2cac5568f45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:04.726632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029712d-c8a7-4f34-9566-2cac5568f45f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:04.731243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:04.735367 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 110/214] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:04.736148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029712d-c8a7-4f34-9566-2cac5568f45f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:04.777089 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f55c56-a7f4-42e2-bd0a-4527b0738786 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:04.810343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f8cea-a52a-48a1-9004-a6ddc40b28cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:04.810968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8cea-a52a-48a1-9004-a6ddc40b28cc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.811248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8cea-a52a-48a1-9004-a6ddc40b28cc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.811521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8cea-a52a-48a1-9004-a6ddc40b28cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.821548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f8cea-a52a-48a1-9004-a6ddc40b28cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7b8f8cea-a52a-48a1-9004-a6ddc40b28cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:04.826560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:04.827477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:04.828431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 105/215] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:04.829263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f8cea-a52a-48a1-9004-a6ddc40b28cc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:04.835570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029712d-c8a7-4f34-9566-2cac5568f45f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:04.870608 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e031b3-edaf-4aa1-b0a8-3d0498efc29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:04.871214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e031b3-edaf-4aa1-b0a8-3d0498efc29e None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.871490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e031b3-edaf-4aa1-b0a8-3d0498efc29e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.871757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e031b3-edaf-4aa1-b0a8-3d0498efc29e None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:04.872405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e031b3-edaf-4aa1-b0a8-3d0498efc29e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:04.873908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e031b3-edaf-4aa1-b0a8-3d0498efc29e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:04.881820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:04.895294 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 111/216] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:21:04 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:04.902002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e031b3-edaf-4aa1-b0a8-3d0498efc29e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:04.939923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f8cea-a52a-48a1-9004-a6ddc40b28cc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:04.959961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:04.986765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc079c-9559-4831-a2fc-d932f5504980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:04.987586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc079c-9559-4831-a2fc-d932f5504980 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:04.987868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc079c-9559-4831-a2fc-d932f5504980 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:04.988140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc079c-9559-4831-a2fc-d932f5504980 None admin] PATH_INFO: `/v3/users/e8b94411e1d14ccbbda53cceca5fc590` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:05.004761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc079c-9559-4831-a2fc-d932f5504980 None admin] RBAC: Authorizing `identity:get_user(user_id=e8b94411e1d14ccbbda53cceca5fc590)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:05.006272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc079c-9559-4831-a2fc-d932f5504980 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:05.008173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 106/217] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:21:04 2022] GET /identity/v3/users/e8b94411e1d14ccbbda53cceca5fc590 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:05.014287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc079c-9559-4831-a2fc-d932f5504980 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:05.032604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e031b3-edaf-4aa1-b0a8-3d0498efc29e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:05.073896 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2591a3-13ab-418d-ac66-69fa465e60de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:05.074489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2591a3-13ab-418d-ac66-69fa465e60de None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:05.075015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2591a3-13ab-418d-ac66-69fa465e60de None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:05.075120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2591a3-13ab-418d-ac66-69fa465e60de None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:05.075786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2591a3-13ab-418d-ac66-69fa465e60de None admin] RBAC: Adding query filter params (name=reader) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:05.076094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2591a3-13ab-418d-ac66-69fa465e60de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:05.077573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2591a3-13ab-418d-ac66-69fa465e60de None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:05.085992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 112/218] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:05.092015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2591a3-13ab-418d-ac66-69fa465e60de None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:05.138738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc079c-9559-4831-a2fc-d932f5504980 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:05.165336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:05.177338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f2d05-fcb1-4887-a0b5-12d375e6f392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:05.178201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f2d05-fcb1-4887-a0b5-12d375e6f392 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:05.178677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f2d05-fcb1-4887-a0b5-12d375e6f392 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:05.179223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f2d05-fcb1-4887-a0b5-12d375e6f392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:05.180103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f2d05-fcb1-4887-a0b5-12d375e6f392 None admin] RBAC: Adding query filter params (role.id=f36bf60d6adc430cb9cd4b01f399fa18, user.id=e8b94411e1d14ccbbda53cceca5fc590, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:05.180643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f2d05-fcb1-4887-a0b5-12d375e6f392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:05.182353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f2d05-fcb1-4887-a0b5-12d375e6f392 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:05.189192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 107/219] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Nov 2 03:21:05 2022] GET /identity/v3/role_assignments?user.id=e8b94411e1d14ccbbda53cceca5fc590&scope.system=all&role.id=f36bf60d6adc430cb9cd4b01f399fa18 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:05.225748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2591a3-13ab-418d-ac66-69fa465e60de None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:05.268021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ea785-f842-4b94-9fda-d16e0cc35d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:05.269097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ea785-f842-4b94-9fda-d16e0cc35d1f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:05.269577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ea785-f842-4b94-9fda-d16e0cc35d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:05.270044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ea785-f842-4b94-9fda-d16e0cc35d1f None admin] PATH_INFO: `/v3/users/57a27005cb17400d8d8d5cb2bc5259c6` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:05.271576 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ea785-f842-4b94-9fda-d16e0cc35d1f None admin] RBAC: Authorizing `identity:get_user(user_id=57a27005cb17400d8d8d5cb2bc5259c6)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:05.273590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ea785-f842-4b94-9fda-d16e0cc35d1f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:05.275603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 113/220] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:21:05 2022] GET /identity/v3/users/57a27005cb17400d8d8d5cb2bc5259c6 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:05.281596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f2d05-fcb1-4887-a0b5-12d375e6f392 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:05.321343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:05.398810 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f2d05-fcb1-4887-a0b5-12d375e6f392 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:05.434781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fcd41-0190-4ccd-ab4b-05d9fd6b86dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:05.435732 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fcd41-0190-4ccd-ab4b-05d9fd6b86dd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:05.436204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fcd41-0190-4ccd-ab4b-05d9fd6b86dd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:05.436697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fcd41-0190-4ccd-ab4b-05d9fd6b86dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:05.507092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fcd41-0190-4ccd-ab4b-05d9fd6b86dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:05.508925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fcd41-0190-4ccd-ab4b-05d9fd6b86dd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:05.544245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:05.614945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 108/221] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:05.621636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ea785-f842-4b94-9fda-d16e0cc35d1f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:05.727332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ea785-f842-4b94-9fda-d16e0cc35d1f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:05.748876 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:05.768633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972cc0-a21a-463f-b43b-b39c3422d656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:05.769271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972cc0-a21a-463f-b43b-b39c3422d656 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:05.769553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972cc0-a21a-463f-b43b-b39c3422d656 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:05.769824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972cc0-a21a-463f-b43b-b39c3422d656 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:05.770946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972cc0-a21a-463f-b43b-b39c3422d656 None admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:05.772390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972cc0-a21a-463f-b43b-b39c3422d656 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:05.774044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 114/222] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:21:05 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:05.780154 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fcd41-0190-4ccd-ab4b-05d9fd6b86dd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:05.887268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fcd41-0190-4ccd-ab4b-05d9fd6b86dd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:05.921696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043db29-57a7-4990-a915-1b6c3e0f2906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:05.922308 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043db29-57a7-4990-a915-1b6c3e0f2906 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:05.922586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043db29-57a7-4990-a915-1b6c3e0f2906 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:05.922853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043db29-57a7-4990-a915-1b6c3e0f2906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:05.923575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043db29-57a7-4990-a915-1b6c3e0f2906 None admin] RBAC: Adding query filter params (role.id=89fe31f4d186444ba9cb0a45fed64ae7, scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b, user.id=57a27005cb17400d8d8d5cb2bc5259c6) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:05.923880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043db29-57a7-4990-a915-1b6c3e0f2906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:05.925391 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043db29-57a7-4990-a915-1b6c3e0f2906 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:05.931699 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 109/223] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:21:05 2022] GET /identity/v3/role_assignments?user.id=57a27005cb17400d8d8d5cb2bc5259c6&scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b&role.id=89fe31f4d186444ba9cb0a45fed64ae7 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:05.933179 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:07.243262 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3437fc-db94-4c7d-bbe3-54f11436c8a8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:07.243767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3437fc-db94-4c7d-bbe3-54f11436c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:07.243841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3437fc-db94-4c7d-bbe3-54f11436c8a8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:07.247116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 115/224] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:07.251150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4ab5-6ae8-4102-8ae6-64c151a40fb4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:07.251555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4ab5-6ae8-4102-8ae6-64c151a40fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:07.251729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4ab5-6ae8-4102-8ae6-64c151a40fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:07.270669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-84ec4ab5-6ae8-4102-8ae6-64c151a40fb4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:07.271847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-84ec4ab5-6ae8-4102-8ae6-64c151a40fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:07.300125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f559e4-bd0a-4838-802d-65a952780384 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:07.300406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f559e4-bd0a-4838-802d-65a952780384 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:07.300636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f559e4-bd0a-4838-802d-65a952780384 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:07.302314 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 116/225] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:21:07.309754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c699dab-25fb-432a-93e2-ffc7beaa69fa None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:07.310079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c699dab-25fb-432a-93e2-ffc7beaa69fa None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:07.310318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c699dab-25fb-432a-93e2-ffc7beaa69fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:07.329870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4c699dab-25fb-432a-93e2-ffc7beaa69fa None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:07.331098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4c699dab-25fb-432a-93e2-ffc7beaa69fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:07.347701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 110/226] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:07.401370 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 117/227] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:21:07.422417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85200b-5ca6-48b7-9479-a77ea91aa47e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:07.422707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85200b-5ca6-48b7-9479-a77ea91aa47e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:07.422980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85200b-5ca6-48b7-9479-a77ea91aa47e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:07.424454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 111/228] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:07.429356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc47a-5328-45fe-b24c-6ecebbcd5f42 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:07.429648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc47a-5328-45fe-b24c-6ecebbcd5f42 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:07.429929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc47a-5328-45fe-b24c-6ecebbcd5f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:07.448971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-502fc47a-5328-45fe-b24c-6ecebbcd5f42 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:07.450154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-502fc47a-5328-45fe-b24c-6ecebbcd5f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:07.516740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 118/229] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:07.614431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85200b-5ca6-48b7-9479-a77ea91aa47e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:07.686122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fc47a-5328-45fe-b24c-6ecebbcd5f42 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:07.720046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85200b-5ca6-48b7-9479-a77ea91aa47e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:07.736747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:07.750008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:07.756100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5fdc8-5e71-4afb-8b99-9236d5572032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:07.756859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5fdc8-5e71-4afb-8b99-9236d5572032 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:07.757137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5fdc8-5e71-4afb-8b99-9236d5572032 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:07.757441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5fdc8-5e71-4afb-8b99-9236d5572032 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:07.767776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5fdc8-5e71-4afb-8b99-9236d5572032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ddd5fdc8-5e71-4afb-8b99-9236d5572032 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:07.772592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:07.773464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:07.774394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 112/230] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:07.780070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5fdc8-5e71-4afb-8b99-9236d5572032 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:07.795710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fc47a-5328-45fe-b24c-6ecebbcd5f42 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:07.829278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5a353-f0ef-4806-8ac3-ad6a5e0a2ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:07.829908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5a353-f0ef-4806-8ac3-ad6a5e0a2ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:07.830193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5a353-f0ef-4806-8ac3-ad6a5e0a2ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:07.830467 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5a353-f0ef-4806-8ac3-ad6a5e0a2ee6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:07.831562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5a353-f0ef-4806-8ac3-ad6a5e0a2ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:07.833050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5a353-f0ef-4806-8ac3-ad6a5e0a2ee6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:07.834603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 119/231] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:07.837298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5a353-f0ef-4806-8ac3-ad6a5e0a2ee6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:07.879903 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5fdc8-5e71-4afb-8b99-9236d5572032 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:07.912848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7f382-502f-4d01-a744-36635b9f7039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:07.913455 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7f382-502f-4d01-a744-36635b9f7039 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:07.913738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7f382-502f-4d01-a744-36635b9f7039 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:07.914013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7f382-502f-4d01-a744-36635b9f7039 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:07.914673 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7f382-502f-4d01-a744-36635b9f7039 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:07.914974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7f382-502f-4d01-a744-36635b9f7039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:07.916410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7f382-502f-4d01-a744-36635b9f7039 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:07.925098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 113/232] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:07.930010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7f382-502f-4d01-a744-36635b9f7039 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:07.938672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5a353-f0ef-4806-8ac3-ad6a5e0a2ee6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:07.954450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:07.973341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd096637-544e-4de4-ba72-04eb1cd7728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:07.973960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd096637-544e-4de4-ba72-04eb1cd7728a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:07.974245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd096637-544e-4de4-ba72-04eb1cd7728a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:07.974516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd096637-544e-4de4-ba72-04eb1cd7728a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:07.977105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:07.985285 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd096637-544e-4de4-ba72-04eb1cd7728a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-fd096637-544e-4de4-ba72-04eb1cd7728a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:07.990827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:07.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:07.992536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 120/233] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:07.993575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd096637-544e-4de4-ba72-04eb1cd7728a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:08.030192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7f382-502f-4d01-a744-36635b9f7039 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:08.066995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3abd52-c208-45ec-bbff-539cb2913c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:08.067606 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3abd52-c208-45ec-bbff-539cb2913c09 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:08.067889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3abd52-c208-45ec-bbff-539cb2913c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:08.068165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3abd52-c208-45ec-bbff-539cb2913c09 None admin] PATH_INFO: `/v3/groups` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:08.068821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3abd52-c208-45ec-bbff-539cb2913c09 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:08.070248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3abd52-c208-45ec-bbff-539cb2913c09 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:08.086165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 114/234] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Nov 2 03:21:07 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:08.086957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3abd52-c208-45ec-bbff-539cb2913c09 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:08.097156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd096637-544e-4de4-ba72-04eb1cd7728a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:08.136595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39719eef-fe0e-477a-8d32-2180a0333e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:08.137179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39719eef-fe0e-477a-8d32-2180a0333e03 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:08.137446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39719eef-fe0e-477a-8d32-2180a0333e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:08.137724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39719eef-fe0e-477a-8d32-2180a0333e03 None admin] PATH_INFO: `/v3/users/eda09bee195b4de1a57714f35c148ab0` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:08.155050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39719eef-fe0e-477a-8d32-2180a0333e03 None admin] RBAC: Authorizing `identity:get_user(user_id=eda09bee195b4de1a57714f35c148ab0)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:08.157358 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39719eef-fe0e-477a-8d32-2180a0333e03 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:08.160344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 121/235] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:21:07 2022] GET /identity/v3/users/eda09bee195b4de1a57714f35c148ab0 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:08.166208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39719eef-fe0e-477a-8d32-2180a0333e03 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:08.205431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:08.206902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3abd52-c208-45ec-bbff-539cb2913c09 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:08.221749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:08.251851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda6a3e-e7d0-4606-b3fe-8df470aba3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:08.252575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda6a3e-e7d0-4606-b3fe-8df470aba3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:08.252768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda6a3e-e7d0-4606-b3fe-8df470aba3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:08.253038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda6a3e-e7d0-4606-b3fe-8df470aba3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:08.253707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda6a3e-e7d0-4606-b3fe-8df470aba3a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:08.254007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda6a3e-e7d0-4606-b3fe-8df470aba3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:08.255377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda6a3e-e7d0-4606-b3fe-8df470aba3a2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:08.265512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 115/236] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:08.270881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda6a3e-e7d0-4606-b3fe-8df470aba3a2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:08.289324 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39719eef-fe0e-477a-8d32-2180a0333e03 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:08.327569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ad340-3594-48e3-a970-3e9d0eddde4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:08.328182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ad340-3594-48e3-a970-3e9d0eddde4f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:08.328481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ad340-3594-48e3-a970-3e9d0eddde4f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:08.328770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ad340-3594-48e3-a970-3e9d0eddde4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:08.329487 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ad340-3594-48e3-a970-3e9d0eddde4f None admin] RBAC: Adding query filter params (role.id=89fe31f4d186444ba9cb0a45fed64ae7, user.id=eda09bee195b4de1a57714f35c148ab0, scope.system=all) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:08.329795 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ad340-3594-48e3-a970-3e9d0eddde4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:08.331222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ad340-3594-48e3-a970-3e9d0eddde4f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:08.336067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 122/237] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Nov 2 03:21:08 2022] GET /identity/v3/role_assignments?user.id=eda09bee195b4de1a57714f35c148ab0&scope.system=all&role.id=89fe31f4d186444ba9cb0a45fed64ae7 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:08.390907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda6a3e-e7d0-4606-b3fe-8df470aba3a2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:08.429172 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cedbb9-47c6-4d40-9b87-b4fbf6011e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:08.430075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cedbb9-47c6-4d40-9b87-b4fbf6011e77 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:08.430544 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cedbb9-47c6-4d40-9b87-b4fbf6011e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:08.430974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cedbb9-47c6-4d40-9b87-b4fbf6011e77 None admin] PATH_INFO: `/v3/users/e8b94411e1d14ccbbda53cceca5fc590` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:08.432603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cedbb9-47c6-4d40-9b87-b4fbf6011e77 None admin] RBAC: Authorizing `identity:get_user(user_id=e8b94411e1d14ccbbda53cceca5fc590)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:08.434229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cedbb9-47c6-4d40-9b87-b4fbf6011e77 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:08.436419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 116/238] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:21:08 2022] GET /identity/v3/users/e8b94411e1d14ccbbda53cceca5fc590 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:08.442151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ad340-3594-48e3-a970-3e9d0eddde4f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:08.548193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:08.552687 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ad340-3594-48e3-a970-3e9d0eddde4f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:08.588029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bfe2e-3116-428a-9c6a-8995e122c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:08.589325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bfe2e-3116-428a-9c6a-8995e122c153 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:08.589778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bfe2e-3116-428a-9c6a-8995e122c153 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:08.590132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bfe2e-3116-428a-9c6a-8995e122c153 None admin] PATH_INFO: `/v3/system/users/e8b94411e1d14ccbbda53cceca5fc590/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:08.591623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bfe2e-3116-428a-9c6a-8995e122c153 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e8b94411e1d14ccbbda53cceca5fc590, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:08.593125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bfe2e-3116-428a-9c6a-8995e122c153 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:08.602604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 123/239] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Nov 2 03:21:08 2022] PUT /identity/v3/system/users/e8b94411e1d14ccbbda53cceca5fc590/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:21:10.285002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da79ad-77e6-44ad-a562-fbbc4141feff None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:10.285506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da79ad-77e6-44ad-a562-fbbc4141feff None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:10.285577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da79ad-77e6-44ad-a562-fbbc4141feff None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:10.286921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 117/240] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:10.292640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c1eed-7df3-457a-b27f-32c9776bde89 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:10.293035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c1eed-7df3-457a-b27f-32c9776bde89 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:10.293191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c1eed-7df3-457a-b27f-32c9776bde89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:10.311338 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-950c1eed-7df3-457a-b27f-32c9776bde89 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:10.312451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-950c1eed-7df3-457a-b27f-32c9776bde89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:10.386078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 124/241] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:10.464824 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6b05b-c432-4b56-a3d7-448c53e23d6f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:10.465130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6b05b-c432-4b56-a3d7-448c53e23d6f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:10.465382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6b05b-c432-4b56-a3d7-448c53e23d6f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:10.466723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 118/242] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:10.471868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05704b5-d698-4ad2-a4ef-f06398a7a61e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:10.472155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05704b5-d698-4ad2-a4ef-f06398a7a61e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:10.472426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05704b5-d698-4ad2-a4ef-f06398a7a61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:10.492075 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a05704b5-d698-4ad2-a4ef-f06398a7a61e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:10.493270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a05704b5-d698-4ad2-a4ef-f06398a7a61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:10.568580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 125/243] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:10.649303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6b05b-c432-4b56-a3d7-448c53e23d6f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:10.698777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:10.761633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6b05b-c432-4b56-a3d7-448c53e23d6f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:10.771538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95edc2-63af-4244-9b70-043d826e26b3 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:10.771834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95edc2-63af-4244-9b70-043d826e26b3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:10.772111 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95edc2-63af-4244-9b70-043d826e26b3 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:10.773629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 126/244] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:21:10.778318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af662-e7d2-4212-9252-738085507f42 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:10.778609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af662-e7d2-4212-9252-738085507f42 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:10.778892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af662-e7d2-4212-9252-738085507f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:10.796329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615be45-964f-436e-b47c-71236700123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:10.796983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615be45-964f-436e-b47c-71236700123a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:10.797083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-672af662-e7d2-4212-9252-738085507f42 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:10.797256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615be45-964f-436e-b47c-71236700123a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:10.797518 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615be45-964f-436e-b47c-71236700123a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:10.798176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-672af662-e7d2-4212-9252-738085507f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:10.798595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615be45-964f-436e-b47c-71236700123a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:10.800199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615be45-964f-436e-b47c-71236700123a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:10.802716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 119/245] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:10.808483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615be45-964f-436e-b47c-71236700123a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:10.817088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:10.868541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 127/246] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:21:10.869914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672af662-e7d2-4212-9252-738085507f42 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:10.919896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615be45-964f-436e-b47c-71236700123a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:10.930292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:10.956965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e530b8-0ff6-4d2f-8cb7-4de0fe34806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:10.957580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e530b8-0ff6-4d2f-8cb7-4de0fe34806f None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:10.957858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e530b8-0ff6-4d2f-8cb7-4de0fe34806f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:10.958129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e530b8-0ff6-4d2f-8cb7-4de0fe34806f None admin] PATH_INFO: `/v3/groups` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:10.958751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e530b8-0ff6-4d2f-8cb7-4de0fe34806f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:10.960365 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e530b8-0ff6-4d2f-8cb7-4de0fe34806f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:10.977224 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672af662-e7d2-4212-9252-738085507f42 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:10.987278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 120/247] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Nov 2 03:21:10 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:21:11.017715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84789e8f-7f38-49be-a6f2-2cdb40536b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:11.018364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84789e8f-7f38-49be-a6f2-2cdb40536b55 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:11.018650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84789e8f-7f38-49be-a6f2-2cdb40536b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:11.018918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84789e8f-7f38-49be-a6f2-2cdb40536b55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:11.031379 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84789e8f-7f38-49be-a6f2-2cdb40536b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-84789e8f-7f38-49be-a6f2-2cdb40536b55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:11.036491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:11.037490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:11.043793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 128/248] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:11.046383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e530b8-0ff6-4d2f-8cb7-4de0fe34806f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:11.153239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84789e8f-7f38-49be-a6f2-2cdb40536b55 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:11.158622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e530b8-0ff6-4d2f-8cb7-4de0fe34806f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:11.174765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:11.199419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca8ef8-20a6-4a3d-b969-4f7fde13d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:11.200563 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca8ef8-20a6-4a3d-b969-4f7fde13d80d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:11.200843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca8ef8-20a6-4a3d-b969-4f7fde13d80d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:11.201224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca8ef8-20a6-4a3d-b969-4f7fde13d80d None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:11.201898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca8ef8-20a6-4a3d-b969-4f7fde13d80d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:11.202205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca8ef8-20a6-4a3d-b969-4f7fde13d80d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:11.203592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca8ef8-20a6-4a3d-b969-4f7fde13d80d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:11.212297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 121/249] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:11.218993 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca8ef8-20a6-4a3d-b969-4f7fde13d80d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:11.257214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:11.282634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84789e8f-7f38-49be-a6f2-2cdb40536b55 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:11.322139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e7696-155c-4ab9-a2c8-ff9030ddafd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:11.322923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7696-155c-4ab9-a2c8-ff9030ddafd8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:11.323120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7696-155c-4ab9-a2c8-ff9030ddafd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:11.323431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e7696-155c-4ab9-a2c8-ff9030ddafd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:11.335171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e7696-155c-4ab9-a2c8-ff9030ddafd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:11.337614 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca8ef8-20a6-4a3d-b969-4f7fde13d80d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-466e7696-155c-4ab9-a2c8-ff9030ddafd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:11.340614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:11.341645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:11.342462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 129/250] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:11.347464 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e7696-155c-4ab9-a2c8-ff9030ddafd8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:11.382606 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7effe5-5710-4666-9cef-50e7a5db46f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:11.383239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7effe5-5710-4666-9cef-50e7a5db46f2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:11.383520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7effe5-5710-4666-9cef-50e7a5db46f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:11.383790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7effe5-5710-4666-9cef-50e7a5db46f2 None admin] PATH_INFO: `/v3/users/eda09bee195b4de1a57714f35c148ab0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:11.385037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7effe5-5710-4666-9cef-50e7a5db46f2 None admin] RBAC: Authorizing `identity:get_user(user_id=eda09bee195b4de1a57714f35c148ab0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:11.386587 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7effe5-5710-4666-9cef-50e7a5db46f2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:11.388345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 122/251] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:21:11 2022] GET /identity/v3/users/eda09bee195b4de1a57714f35c148ab0 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:11.393746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7effe5-5710-4666-9cef-50e7a5db46f2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:11.439762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:11.486310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e7696-155c-4ab9-a2c8-ff9030ddafd8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:11.530089 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:11.530680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88385b-225e-4a08-8916-695836c30ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:11.531530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88385b-225e-4a08-8916-695836c30ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:11.532006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88385b-225e-4a08-8916-695836c30ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:11.532505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88385b-225e-4a08-8916-695836c30ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:11.533367 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88385b-225e-4a08-8916-695836c30ec2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:11.533678 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88385b-225e-4a08-8916-695836c30ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:11.535053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88385b-225e-4a08-8916-695836c30ec2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:11.535530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7effe5-5710-4666-9cef-50e7a5db46f2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:11.545286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 130/252] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:11.553510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88385b-225e-4a08-8916-695836c30ec2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:11.575734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76130b64-4b58-4bd1-bb1c-687a1e7f8660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:11.576626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76130b64-4b58-4bd1-bb1c-687a1e7f8660 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:11.577007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76130b64-4b58-4bd1-bb1c-687a1e7f8660 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:11.577381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76130b64-4b58-4bd1-bb1c-687a1e7f8660 None admin] PATH_INFO: `/v3/system/users/eda09bee195b4de1a57714f35c148ab0/roles/89fe31f4d186444ba9cb0a45fed64ae7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:11.578898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76130b64-4b58-4bd1-bb1c-687a1e7f8660 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eda09bee195b4de1a57714f35c148ab0, role_id=89fe31f4d186444ba9cb0a45fed64ae7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:11.580541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76130b64-4b58-4bd1-bb1c-687a1e7f8660 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:11.593993 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 123/253] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Nov 2 03:21:11 2022] PUT /identity/v3/system/users/eda09bee195b4de1a57714f35c148ab0/roles/89fe31f4d186444ba9cb0a45fed64ae7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:11.668187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88385b-225e-4a08-8916-695836c30ec2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:11.706739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee615796-10a6-4eb7-8c3b-dcb8caeb245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:11.707388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615796-10a6-4eb7-8c3b-dcb8caeb245a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:11.707669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615796-10a6-4eb7-8c3b-dcb8caeb245a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:11.707942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615796-10a6-4eb7-8c3b-dcb8caeb245a None admin] PATH_INFO: `/v3/users/e8b94411e1d14ccbbda53cceca5fc590` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:11.709163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee615796-10a6-4eb7-8c3b-dcb8caeb245a None admin] RBAC: Authorizing `identity:get_user(user_id=e8b94411e1d14ccbbda53cceca5fc590)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:11.710637 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee615796-10a6-4eb7-8c3b-dcb8caeb245a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:11.712702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 131/254] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:21:11 2022] GET /identity/v3/users/e8b94411e1d14ccbbda53cceca5fc590 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:11.718917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76130b64-4b58-4bd1-bb1c-687a1e7f8660 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:11.851016 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76130b64-4b58-4bd1-bb1c-687a1e7f8660 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:11.895571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e57c-3895-47ad-8eac-9969e5ec9869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:11.896189 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e57c-3895-47ad-8eac-9969e5ec9869 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:11.896487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e57c-3895-47ad-8eac-9969e5ec9869 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:11.896787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e57c-3895-47ad-8eac-9969e5ec9869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:11.897519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e57c-3895-47ad-8eac-9969e5ec9869 None admin] RBAC: Adding query filter params (role.id=f36bf60d6adc430cb9cd4b01f399fa18, user.id=e8b94411e1d14ccbbda53cceca5fc590, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:11.897827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e57c-3895-47ad-8eac-9969e5ec9869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:11.899332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e57c-3895-47ad-8eac-9969e5ec9869 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:11.912719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 124/255] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Nov 2 03:21:11 2022] GET /identity/v3/role_assignments?user.id=e8b94411e1d14ccbbda53cceca5fc590&scope.system=all&role.id=f36bf60d6adc430cb9cd4b01f399fa18 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:13.576755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd8014-5bc4-470b-81e9-d4c4b7e74dd5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:13.577592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd8014-5bc4-470b-81e9-d4c4b7e74dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:13.578030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd8014-5bc4-470b-81e9-d4c4b7e74dd5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:13.579767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 132/256] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:13.584842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce11a-8d6c-44a1-8bff-d1ecf7e4c17a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:13.585270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce11a-8d6c-44a1-8bff-d1ecf7e4c17a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:13.585579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce11a-8d6c-44a1-8bff-d1ecf7e4c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:13.613812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-403ce11a-8d6c-44a1-8bff-d1ecf7e4c17a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:13.615282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-403ce11a-8d6c-44a1-8bff-d1ecf7e4c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:13.642184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:13.693571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 125/257] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 03:21:14.160126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005e55-1e00-466c-be03-b7d3219aa553 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.160834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005e55-1e00-466c-be03-b7d3219aa553 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.161323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005e55-1e00-466c-be03-b7d3219aa553 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.162872 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 133/258] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:14.168860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06027363-e924-48cd-8c79-ef07be11ff13 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.169153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06027363-e924-48cd-8c79-ef07be11ff13 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.169429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06027363-e924-48cd-8c79-ef07be11ff13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.186194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375243f-cef0-4366-9004-70c7f5363714 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.186483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375243f-cef0-4366-9004-70c7f5363714 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.186756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375243f-cef0-4366-9004-70c7f5363714 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.188095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 134/259] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:14.193269 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f491e-3908-49aa-8afe-a296f8e6807b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.193587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f491e-3908-49aa-8afe-a296f8e6807b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.193828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f491e-3908-49aa-8afe-a296f8e6807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.195587 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-06027363-e924-48cd-8c79-ef07be11ff13 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:14.197026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-06027363-e924-48cd-8c79-ef07be11ff13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:14.208844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:14.210727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 126/260] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 03:21:14.233458 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-289f491e-3908-49aa-8afe-a296f8e6807b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:14.234673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-289f491e-3908-49aa-8afe-a296f8e6807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:14.246936 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 135/261] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 03:21:14.257942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06027363-e924-48cd-8c79-ef07be11ff13 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.273572 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06027363-e924-48cd-8c79-ef07be11ff13 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.284591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a72b2-4c23-4dcf-b76f-a36dbfa8befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.285507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a72b2-4c23-4dcf-b76f-a36dbfa8befc admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.285977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a72b2-4c23-4dcf-b76f-a36dbfa8befc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.286436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a72b2-4c23-4dcf-b76f-a36dbfa8befc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.309673 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a72b2-4c23-4dcf-b76f-a36dbfa8befc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8b5a72b2-4c23-4dcf-b76f-a36dbfa8befc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:14.314891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:14.315725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:14.316534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:14.319109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 127/262] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:14.325867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f491e-3908-49aa-8afe-a296f8e6807b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.342188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f491e-3908-49aa-8afe-a296f8e6807b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.353104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218fc04-771d-4fd9-9b88-60f617193484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.354260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218fc04-771d-4fd9-9b88-60f617193484 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.354539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218fc04-771d-4fd9-9b88-60f617193484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.354814 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218fc04-771d-4fd9-9b88-60f617193484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.355501 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218fc04-771d-4fd9-9b88-60f617193484 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:14.355917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218fc04-771d-4fd9-9b88-60f617193484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:14.357780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-f218fc04-771d-4fd9-9b88-60f617193484 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:21:14.357780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: warnings.warn(msg) Nov 02 03:21:14.357780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: Nov 02 03:21:14.358692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218fc04-771d-4fd9-9b88-60f617193484 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:14.374917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 136/263] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:14.380445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a72b2-4c23-4dcf-b76f-a36dbfa8befc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.393650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a72b2-4c23-4dcf-b76f-a36dbfa8befc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.405498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986b41-7069-47ef-9a53-1dcc2d917b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.406534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986b41-7069-47ef-9a53-1dcc2d917b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.407052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986b41-7069-47ef-9a53-1dcc2d917b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.407521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986b41-7069-47ef-9a53-1dcc2d917b7e admin admin] PATH_INFO: `/v3/groups/3602ec51afaf46318dcfd97af88e7dfe` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.420142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d986b41-7069-47ef-9a53-1dcc2d917b7e admin admin] RBAC: Authorizing `identity:get_group(group_id=3602ec51afaf46318dcfd97af88e7dfe)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:14.422324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-5d986b41-7069-47ef-9a53-1dcc2d917b7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:21:14.422324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Nov 02 03:21:14.422324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: Nov 02 03:21:14.423972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d986b41-7069-47ef-9a53-1dcc2d917b7e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:14.425997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 128/264] 10.222.0.20 () {56 vars in 1201 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/groups/3602ec51afaf46318dcfd97af88e7dfe => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:14.431578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218fc04-771d-4fd9-9b88-60f617193484 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.445440 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218fc04-771d-4fd9-9b88-60f617193484 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.452502 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098b863-6bd9-4af0-8b17-da3ec333cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.453156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098b863-6bd9-4af0-8b17-da3ec333cfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.453439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098b863-6bd9-4af0-8b17-da3ec333cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.453713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098b863-6bd9-4af0-8b17-da3ec333cfa2 admin admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.457129 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098b863-6bd9-4af0-8b17-da3ec333cfa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:14.459225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098b863-6bd9-4af0-8b17-da3ec333cfa2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:14.461223 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 137/265] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:14.467706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986b41-7069-47ef-9a53-1dcc2d917b7e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.481686 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986b41-7069-47ef-9a53-1dcc2d917b7e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.492680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccb5dc-6247-4cf2-b87f-4cb0ade895f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.493624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccb5dc-6247-4cf2-b87f-4cb0ade895f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.494096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccb5dc-6247-4cf2-b87f-4cb0ade895f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.495288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccb5dc-6247-4cf2-b87f-4cb0ade895f3 admin admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09/groups/3602ec51afaf46318dcfd97af88e7dfe/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.501720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccb5dc-6247-4cf2-b87f-4cb0ade895f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a169391a6f324e26a7a0b1278ba35a09, group_id=3602ec51afaf46318dcfd97af88e7dfe, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:14.502955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-f6ccb5dc-6247-4cf2-b87f-4cb0ade895f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:21:14.502955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Nov 02 03:21:14.502955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: Nov 02 03:21:14.505314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccb5dc-6247-4cf2-b87f-4cb0ade895f3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:14.533817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 129/266] 10.222.0.20 () {58 vars in 1463 bytes} [Wed Nov 2 03:21:14 2022] PUT /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09/groups/3602ec51afaf46318dcfd97af88e7dfe/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:14.600433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a91d8-7721-4e3a-962d-f1b20885112f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.600941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a91d8-7721-4e3a-962d-f1b20885112f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.600941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a91d8-7721-4e3a-962d-f1b20885112f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.602489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 138/267] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:14.623404 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f72d1-e940-44a1-a9bf-00412ebf98aa None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.624339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f72d1-e940-44a1-a9bf-00412ebf98aa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.624846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f72d1-e940-44a1-a9bf-00412ebf98aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.649791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d93f72d1-e940-44a1-a9bf-00412ebf98aa None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:14.651933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d93f72d1-e940-44a1-a9bf-00412ebf98aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:14.684147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a91d8-7721-4e3a-962d-f1b20885112f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.744819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 130/268] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:14.750147 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f72d1-e940-44a1-a9bf-00412ebf98aa None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.832893 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a91d8-7721-4e3a-962d-f1b20885112f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.838562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb7e6c-a053-443e-ad4e-08f2ed5d5ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.839209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7e6c-a053-443e-ad4e-08f2ed5d5ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.839490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7e6c-a053-443e-ad4e-08f2ed5d5ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.839767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7e6c-a053-443e-ad4e-08f2ed5d5ad8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.840266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f72d1-e940-44a1-a9bf-00412ebf98aa None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.847667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3de54-c493-4ae8-8096-17761d660cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.848683 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3de54-c493-4ae8-8096-17761d660cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.849156 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3de54-c493-4ae8-8096-17761d660cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.849636 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3de54-c493-4ae8-8096-17761d660cf3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.854188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb7e6c-a053-443e-ad4e-08f2ed5d5ad8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:14.858990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-76fb7e6c-a053-443e-ad4e-08f2ed5d5ad8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:14.859997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:14.861827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:14.862607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 139/269] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:14.867697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3de54-c493-4ae8-8096-17761d660cf3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:14.868339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb7e6c-a053-443e-ad4e-08f2ed5d5ad8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8fb3de54-c493-4ae8-8096-17761d660cf3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:14.874426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:14.875488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:21:14.876424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:14.879577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 131/270] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:14.885230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3de54-c493-4ae8-8096-17761d660cf3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.887565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb7e6c-a053-443e-ad4e-08f2ed5d5ad8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.893625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005da152-8d01-4ada-a6f4-06ec0f375824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.894465 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da152-8d01-4ada-a6f4-06ec0f375824 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.895133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da152-8d01-4ada-a6f4-06ec0f375824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.895566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da152-8d01-4ada-a6f4-06ec0f375824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.896372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005da152-8d01-4ada-a6f4-06ec0f375824 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:14.896886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005da152-8d01-4ada-a6f4-06ec0f375824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:14.897457 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3de54-c493-4ae8-8096-17761d660cf3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.898800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005da152-8d01-4ada-a6f4-06ec0f375824 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:14.902976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e300de-8e8b-428e-be67-7769da2c9c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.903684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e300de-8e8b-428e-be67-7769da2c9c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.904057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e300de-8e8b-428e-be67-7769da2c9c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.904473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e300de-8e8b-428e-be67-7769da2c9c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.905271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e300de-8e8b-428e-be67-7769da2c9c89 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:14.905675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e300de-8e8b-428e-be67-7769da2c9c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:14.907372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-b7e300de-8e8b-428e-be67-7769da2c9c89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:21:14.907372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Nov 02 03:21:14.907372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: Nov 02 03:21:14.910228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 140/271] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:14.910605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e300de-8e8b-428e-be67-7769da2c9c89 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:14.919403 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005da152-8d01-4ada-a6f4-06ec0f375824 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.932449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 132/272] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:14.939997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e300de-8e8b-428e-be67-7769da2c9c89 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.940721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005da152-8d01-4ada-a6f4-06ec0f375824 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.945873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1903f-ba73-4d0d-8bee-bbe2d8b942d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.948147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1903f-ba73-4d0d-8bee-bbe2d8b942d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.948690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1903f-ba73-4d0d-8bee-bbe2d8b942d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.949418 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1903f-ba73-4d0d-8bee-bbe2d8b942d0 admin admin] PATH_INFO: `/v3/groups/3602ec51afaf46318dcfd97af88e7dfe` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.950743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1903f-ba73-4d0d-8bee-bbe2d8b942d0 admin admin] RBAC: Authorizing `identity:get_group(group_id=3602ec51afaf46318dcfd97af88e7dfe)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:14.951490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e300de-8e8b-428e-be67-7769da2c9c89 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.952180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-26f1903f-ba73-4d0d-8bee-bbe2d8b942d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:21:14.952180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: warnings.warn(msg) Nov 02 03:21:14.952180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: Nov 02 03:21:14.954155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1903f-ba73-4d0d-8bee-bbe2d8b942d0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:14.956384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491beece-bc15-4618-9f23-8f32e0fcf2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.956656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 141/273] 10.222.0.20 () {56 vars in 1201 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/groups/3602ec51afaf46318dcfd97af88e7dfe => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:14.960542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491beece-bc15-4618-9f23-8f32e0fcf2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.960542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491beece-bc15-4618-9f23-8f32e0fcf2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.960542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491beece-bc15-4618-9f23-8f32e0fcf2d2 admin admin] PATH_INFO: `/v3/groups/3602ec51afaf46318dcfd97af88e7dfe` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.961783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491beece-bc15-4618-9f23-8f32e0fcf2d2 admin admin] RBAC: Authorizing `identity:get_group(group_id=3602ec51afaf46318dcfd97af88e7dfe)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:14.962540 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1903f-ba73-4d0d-8bee-bbe2d8b942d0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.964252 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491beece-bc15-4618-9f23-8f32e0fcf2d2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:14.966144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 133/274] 10.222.0.20 () {56 vars in 1201 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/groups/3602ec51afaf46318dcfd97af88e7dfe => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:14.973424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491beece-bc15-4618-9f23-8f32e0fcf2d2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:14.977938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1903f-ba73-4d0d-8bee-bbe2d8b942d0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.989714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67356b2b-be4e-4a7e-a01f-1e191f579494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:14.990629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67356b2b-be4e-4a7e-a01f-1e191f579494 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:14.990921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67356b2b-be4e-4a7e-a01f-1e191f579494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:14.991178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67356b2b-be4e-4a7e-a01f-1e191f579494 admin admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:14.994514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491beece-bc15-4618-9f23-8f32e0fcf2d2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:14.995791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67356b2b-be4e-4a7e-a01f-1e191f579494 admin admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:14.997889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67356b2b-be4e-4a7e-a01f-1e191f579494 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:14.999708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 142/275] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:15.003540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd4ed2-4f6a-4a50-8d67-73ddb486f969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:15.004176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4ed2-4f6a-4a50-8d67-73ddb486f969 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:15.004473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4ed2-4f6a-4a50-8d67-73ddb486f969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:15.008807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4ed2-4f6a-4a50-8d67-73ddb486f969 admin admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:15.010516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd4ed2-4f6a-4a50-8d67-73ddb486f969 admin admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:15.012619 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd4ed2-4f6a-4a50-8d67-73ddb486f969 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:15.014591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 134/276] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Nov 2 03:21:14 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:15.016082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67356b2b-be4e-4a7e-a01f-1e191f579494 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:15.026228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67356b2b-be4e-4a7e-a01f-1e191f579494 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:15.030204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd4ed2-4f6a-4a50-8d67-73ddb486f969 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:15.037821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869732c8-7ced-4599-8558-3e5b560605f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:15.038491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869732c8-7ced-4599-8558-3e5b560605f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:15.049743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd4ed2-4f6a-4a50-8d67-73ddb486f969 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:15.050525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869732c8-7ced-4599-8558-3e5b560605f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:15.050865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869732c8-7ced-4599-8558-3e5b560605f2 admin admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/groups/3602ec51afaf46318dcfd97af88e7dfe/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:15.052909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869732c8-7ced-4599-8558-3e5b560605f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ab9b9969c94aa28422c81ea6f32a2b, group_id=3602ec51afaf46318dcfd97af88e7dfe, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:15.054788 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-869732c8-7ced-4599-8558-3e5b560605f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:21:15.054788 dv-cinder-860209-6-smb devstack@keystone.service[81396]: warnings.warn(msg) Nov 02 03:21:15.054788 dv-cinder-860209-6-smb devstack@keystone.service[81396]: Nov 02 03:21:15.056898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869732c8-7ced-4599-8558-3e5b560605f2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:15.063204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c251f9-4c7e-4fe8-b7d2-aefe4dcd5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:15.063980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c251f9-4c7e-4fe8-b7d2-aefe4dcd5524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:15.064264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c251f9-4c7e-4fe8-b7d2-aefe4dcd5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:15.064553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c251f9-4c7e-4fe8-b7d2-aefe4dcd5524 admin admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09/groups/3602ec51afaf46318dcfd97af88e7dfe/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:15.066729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c251f9-4c7e-4fe8-b7d2-aefe4dcd5524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a169391a6f324e26a7a0b1278ba35a09, group_id=3602ec51afaf46318dcfd97af88e7dfe, role_id=d36d8bd9f47e4ea8bef7f96d37d55d3c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:15.071277 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c251f9-4c7e-4fe8-b7d2-aefe4dcd5524 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:15.092959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 143/277] 10.222.0.20 () {58 vars in 1463 bytes} [Wed Nov 2 03:21:15 2022] PUT /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/groups/3602ec51afaf46318dcfd97af88e7dfe/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:15.097456 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 135/278] 10.222.0.20 () {58 vars in 1463 bytes} [Wed Nov 2 03:21:15 2022] PUT /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09/groups/3602ec51afaf46318dcfd97af88e7dfe/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:15.202111 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869732c8-7ced-4599-8558-3e5b560605f2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:15.317375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:15.329266 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869732c8-7ced-4599-8558-3e5b560605f2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:15.372955 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f0f39-e9dd-420b-a9a9-1eb29f7ba2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:15.373656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f0f39-e9dd-420b-a9a9-1eb29f7ba2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:15.373937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f0f39-e9dd-420b-a9a9-1eb29f7ba2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:15.374207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f0f39-e9dd-420b-a9a9-1eb29f7ba2e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:15.387369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f0f39-e9dd-420b-a9a9-1eb29f7ba2e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ba6f0f39-e9dd-420b-a9a9-1eb29f7ba2e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:15.393005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:15.393942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:15.394739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 144/279] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:15.400053 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c251f9-4c7e-4fe8-b7d2-aefe4dcd5524 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:15.515056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c251f9-4c7e-4fe8-b7d2-aefe4dcd5524 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:15.553056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69741f58-bf3e-4373-83b5-1e56313526aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:15.553721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69741f58-bf3e-4373-83b5-1e56313526aa None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:15.553997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69741f58-bf3e-4373-83b5-1e56313526aa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:15.554269 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69741f58-bf3e-4373-83b5-1e56313526aa None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:15.556047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69741f58-bf3e-4373-83b5-1e56313526aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:15.556047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69741f58-bf3e-4373-83b5-1e56313526aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:15.556780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69741f58-bf3e-4373-83b5-1e56313526aa None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:15.566230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 136/280] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:15.572105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f0f39-e9dd-420b-a9a9-1eb29f7ba2e0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:15.681016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f0f39-e9dd-420b-a9a9-1eb29f7ba2e0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:15.717581 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f00bf-88c5-409a-a067-c46c0df69e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:15.718272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f00bf-88c5-409a-a067-c46c0df69e49 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:15.718553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f00bf-88c5-409a-a067-c46c0df69e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:15.718841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f00bf-88c5-409a-a067-c46c0df69e49 None admin] PATH_INFO: `/v3/users/eda09bee195b4de1a57714f35c148ab0` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:15.719965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f00bf-88c5-409a-a067-c46c0df69e49 None admin] RBAC: Authorizing `identity:get_user(user_id=eda09bee195b4de1a57714f35c148ab0)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:15.721567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f00bf-88c5-409a-a067-c46c0df69e49 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:15.723505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 145/281] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:21:15 2022] GET /identity/v3/users/eda09bee195b4de1a57714f35c148ab0 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:15.729775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69741f58-bf3e-4373-83b5-1e56313526aa None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:15.772964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:15.874882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69741f58-bf3e-4373-83b5-1e56313526aa None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:15.913702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44306171-ae89-48c8-8209-4dd66c465431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:15.914313 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306171-ae89-48c8-8209-4dd66c465431 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:15.914618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306171-ae89-48c8-8209-4dd66c465431 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:15.914867 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306171-ae89-48c8-8209-4dd66c465431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:15.915589 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44306171-ae89-48c8-8209-4dd66c465431 None admin] RBAC: Adding query filter params (role.id=89fe31f4d186444ba9cb0a45fed64ae7, user.id=eda09bee195b4de1a57714f35c148ab0, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:15.915893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44306171-ae89-48c8-8209-4dd66c465431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:15.918215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44306171-ae89-48c8-8209-4dd66c465431 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:15.931041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 137/282] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Nov 2 03:21:15 2022] GET /identity/v3/role_assignments?user.id=eda09bee195b4de1a57714f35c148ab0&scope.system=all&role.id=89fe31f4d186444ba9cb0a45fed64ae7 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:15.984046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a196b-26da-41b5-be7d-c66278ad90da None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:15.984740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a196b-26da-41b5-be7d-c66278ad90da None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:15.985251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a196b-26da-41b5-be7d-c66278ad90da None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:15.987227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 146/283] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:15.992822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879494ae-73d2-4be5-85d4-62f3b13cafc3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:15.993100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879494ae-73d2-4be5-85d4-62f3b13cafc3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:15.993377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879494ae-73d2-4be5-85d4-62f3b13cafc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:16.023802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-879494ae-73d2-4be5-85d4-62f3b13cafc3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:16.024979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-879494ae-73d2-4be5-85d4-62f3b13cafc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:16.107164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 138/284] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 03:21:16.597167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a196b-26da-41b5-be7d-c66278ad90da None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:16.614274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a196b-26da-41b5-be7d-c66278ad90da None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:16.621289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd78a3-de10-4eea-b760-105dbd245af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:16.621943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd78a3-de10-4eea-b760-105dbd245af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:16.622221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd78a3-de10-4eea-b760-105dbd245af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:16.622490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd78a3-de10-4eea-b760-105dbd245af7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:16.637705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd78a3-de10-4eea-b760-105dbd245af7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-affd78a3-de10-4eea-b760-105dbd245af7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:16.647761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:16.649883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:16.652690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 147/285] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Nov 2 03:21:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:16.656492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879494ae-73d2-4be5-85d4-62f3b13cafc3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:16.668834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879494ae-73d2-4be5-85d4-62f3b13cafc3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:16.675915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5d548-4c00-47e2-aa4c-d99a7f792009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:16.676566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5d548-4c00-47e2-aa4c-d99a7f792009 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:16.677843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5d548-4c00-47e2-aa4c-d99a7f792009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:16.678137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5d548-4c00-47e2-aa4c-d99a7f792009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:16.678826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5d548-4c00-47e2-aa4c-d99a7f792009 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:16.679128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5d548-4c00-47e2-aa4c-d99a7f792009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:16.680747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5d548-4c00-47e2-aa4c-d99a7f792009 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:16.693688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 139/286] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Nov 2 03:21:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:16.709938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd78a3-de10-4eea-b760-105dbd245af7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:16.726164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd78a3-de10-4eea-b760-105dbd245af7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:16.737353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287592eb-381e-41c0-b21e-1b4b2afd939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:16.739243 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287592eb-381e-41c0-b21e-1b4b2afd939a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:16.739549 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287592eb-381e-41c0-b21e-1b4b2afd939a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:16.740068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287592eb-381e-41c0-b21e-1b4b2afd939a admin admin] PATH_INFO: `/v3/groups/3602ec51afaf46318dcfd97af88e7dfe` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:16.741418 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287592eb-381e-41c0-b21e-1b4b2afd939a admin admin] RBAC: Authorizing `identity:get_group(group_id=3602ec51afaf46318dcfd97af88e7dfe)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:16.743355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287592eb-381e-41c0-b21e-1b4b2afd939a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:16.745289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 148/287] 10.222.0.20 () {56 vars in 1201 bytes} [Wed Nov 2 03:21:16 2022] GET /identity/v3/groups/3602ec51afaf46318dcfd97af88e7dfe => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:16.751084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5d548-4c00-47e2-aa4c-d99a7f792009 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:16.766244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5d548-4c00-47e2-aa4c-d99a7f792009 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:16.777443 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9baf9-42c6-41a5-9e87-2ad2b4cce172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:16.778417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9baf9-42c6-41a5-9e87-2ad2b4cce172 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:16.778894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9baf9-42c6-41a5-9e87-2ad2b4cce172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:16.779382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9baf9-42c6-41a5-9e87-2ad2b4cce172 admin admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:16.783647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9baf9-42c6-41a5-9e87-2ad2b4cce172 admin admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:16.786156 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9baf9-42c6-41a5-9e87-2ad2b4cce172 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:16.788038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 140/288] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Nov 2 03:21:16 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:16.795498 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287592eb-381e-41c0-b21e-1b4b2afd939a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:16.806574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:16.812597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287592eb-381e-41c0-b21e-1b4b2afd939a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:16.829756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97d748-5b7b-4d9d-8fbc-885e9b5827b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:16.830457 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d748-5b7b-4d9d-8fbc-885e9b5827b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:16.830793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d748-5b7b-4d9d-8fbc-885e9b5827b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:16.831069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97d748-5b7b-4d9d-8fbc-885e9b5827b5 admin admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/groups/3602ec51afaf46318dcfd97af88e7dfe/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:16.834756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97d748-5b7b-4d9d-8fbc-885e9b5827b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ab9b9969c94aa28422c81ea6f32a2b, group_id=3602ec51afaf46318dcfd97af88e7dfe, role_id=d36d8bd9f47e4ea8bef7f96d37d55d3c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:16.837455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97d748-5b7b-4d9d-8fbc-885e9b5827b5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:16.862120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 149/289] 10.222.0.20 () {58 vars in 1463 bytes} [Wed Nov 2 03:21:16 2022] PUT /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b/groups/3602ec51afaf46318dcfd97af88e7dfe/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:17.314290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475b8ab-79e6-4ccf-ba54-43185dc0d8f2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:17.314667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475b8ab-79e6-4ccf-ba54-43185dc0d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:17.314859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475b8ab-79e6-4ccf-ba54-43185dc0d8f2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:17.316341 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 141/290] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:17.322922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87d1be-00de-4895-8470-6b5887c26790 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:17.323207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87d1be-00de-4895-8470-6b5887c26790 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:17.323483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87d1be-00de-4895-8470-6b5887c26790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:17.352426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-da87d1be-00de-4895-8470-6b5887c26790 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:17.354836 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-da87d1be-00de-4895-8470-6b5887c26790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:17.437304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 150/291] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 03:21:17.929295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475b8ab-79e6-4ccf-ba54-43185dc0d8f2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:17.944347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475b8ab-79e6-4ccf-ba54-43185dc0d8f2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:17.949727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580180-7fe8-4a27-ae97-b2620e373494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:17.950610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580180-7fe8-4a27-ae97-b2620e373494 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:17.951082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580180-7fe8-4a27-ae97-b2620e373494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:17.951542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580180-7fe8-4a27-ae97-b2620e373494 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:17.957114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de631a-de8e-48ac-9305-d1ef58927a1e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:17.957591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de631a-de8e-48ac-9305-d1ef58927a1e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:17.957666 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de631a-de8e-48ac-9305-d1ef58927a1e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:17.959110 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 151/292] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:17.965144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46c8d-6eec-469e-9160-f16b11ba7610 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:17.965429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46c8d-6eec-469e-9160-f16b11ba7610 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:17.965701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46c8d-6eec-469e-9160-f16b11ba7610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:17.968660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb580180-7fe8-4a27-ae97-b2620e373494 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-cb580180-7fe8-4a27-ae97-b2620e373494 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:17.974204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:17.975056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:17.975816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:17.977992 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 142/293] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Nov 2 03:21:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:17.983558 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580180-7fe8-4a27-ae97-b2620e373494 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:17.993417 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fef46c8d-6eec-469e-9160-f16b11ba7610 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:17.995405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fef46c8d-6eec-469e-9160-f16b11ba7610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:17.998190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580180-7fe8-4a27-ae97-b2620e373494 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:18.011018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd59c9-d05a-465d-a492-b37ccc3f740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:18.011697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd59c9-d05a-465d-a492-b37ccc3f740b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.011972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd59c9-d05a-465d-a492-b37ccc3f740b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.012240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd59c9-d05a-465d-a492-b37ccc3f740b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.013146 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd59c9-d05a-465d-a492-b37ccc3f740b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:18.013454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd59c9-d05a-465d-a492-b37ccc3f740b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:18.015044 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd59c9-d05a-465d-a492-b37ccc3f740b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:18.031957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:18.036621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 143/294] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Nov 2 03:21:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:18.040689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd59c9-d05a-465d-a492-b37ccc3f740b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:18.060051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd59c9-d05a-465d-a492-b37ccc3f740b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:18.075859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952bc7f-933d-47ab-b5db-5c8475479258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:18.076537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952bc7f-933d-47ab-b5db-5c8475479258 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.076821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952bc7f-933d-47ab-b5db-5c8475479258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.077088 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952bc7f-933d-47ab-b5db-5c8475479258 admin admin] PATH_INFO: `/v3/groups/0dac3e6fc90c4cbea902a78df6a61dc9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.086408 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952bc7f-933d-47ab-b5db-5c8475479258 admin admin] RBAC: Authorizing `identity:get_group(group_id=0dac3e6fc90c4cbea902a78df6a61dc9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:18.088970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952bc7f-933d-47ab-b5db-5c8475479258 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:18.090633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 144/295] 10.222.0.20 () {56 vars in 1201 bytes} [Wed Nov 2 03:21:18 2022] GET /identity/v3/groups/0dac3e6fc90c4cbea902a78df6a61dc9 => generated 229 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:18.099786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952bc7f-933d-47ab-b5db-5c8475479258 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:18.125506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952bc7f-933d-47ab-b5db-5c8475479258 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:18.133128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d088c6-f388-4ad3-9123-ad5f1e0154bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:18.133785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d088c6-f388-4ad3-9123-ad5f1e0154bf admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.134064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d088c6-f388-4ad3-9123-ad5f1e0154bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.134340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d088c6-f388-4ad3-9123-ad5f1e0154bf admin admin] PATH_INFO: `/v3/projects/d6472819eb36466497e7080c4f423ed7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.136755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d088c6-f388-4ad3-9123-ad5f1e0154bf admin admin] RBAC: Authorizing `identity:get_project(project_id=d6472819eb36466497e7080c4f423ed7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:18.138560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d088c6-f388-4ad3-9123-ad5f1e0154bf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:18.140228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 145/296] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Nov 2 03:21:18 2022] GET /identity/v3/projects/d6472819eb36466497e7080c4f423ed7 => generated 344 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:18.148231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 152/297] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:18.157305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d088c6-f388-4ad3-9123-ad5f1e0154bf admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:18.169781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d088c6-f388-4ad3-9123-ad5f1e0154bf admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:18.180623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330320e-cca9-4f20-805a-ea09c77bdcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:18.181240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330320e-cca9-4f20-805a-ea09c77bdcc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.182057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330320e-cca9-4f20-805a-ea09c77bdcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.182327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330320e-cca9-4f20-805a-ea09c77bdcc0 admin admin] PATH_INFO: `/v3/projects/d6472819eb36466497e7080c4f423ed7/groups/0dac3e6fc90c4cbea902a78df6a61dc9/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.189775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330320e-cca9-4f20-805a-ea09c77bdcc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6472819eb36466497e7080c4f423ed7, group_id=0dac3e6fc90c4cbea902a78df6a61dc9, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:18.192406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330320e-cca9-4f20-805a-ea09c77bdcc0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:18.215368 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 146/298] 10.222.0.20 () {58 vars in 1463 bytes} [Wed Nov 2 03:21:18 2022] PUT /identity/v3/projects/d6472819eb36466497e7080c4f423ed7/groups/0dac3e6fc90c4cbea902a78df6a61dc9/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:18.251997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66005-4da3-4a7b-8068-168d9588fd8d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.252349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66005-4da3-4a7b-8068-168d9588fd8d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.252593 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66005-4da3-4a7b-8068-168d9588fd8d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.254174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 153/299] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:18.260417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00692fe6-8774-49f0-b2e0-28baef5048ee None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.261216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00692fe6-8774-49f0-b2e0-28baef5048ee None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.261693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00692fe6-8774-49f0-b2e0-28baef5048ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.282901 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-00692fe6-8774-49f0-b2e0-28baef5048ee None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:18.285110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-00692fe6-8774-49f0-b2e0-28baef5048ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:18.384489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1ed1c-a567-414d-91ed-c18b585c41f1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.384489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1ed1c-a567-414d-91ed-c18b585c41f1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.384489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1ed1c-a567-414d-91ed-c18b585c41f1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.384489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 154/300] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:21:18.388887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 147/301] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:18.391515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0655bc-417d-403c-87fd-f2584e324720 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.391805 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0655bc-417d-403c-87fd-f2584e324720 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.392082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0655bc-417d-403c-87fd-f2584e324720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.421031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6f0655bc-417d-403c-87fd-f2584e324720 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:18.422236 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6f0655bc-417d-403c-87fd-f2584e324720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:18.504231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:18.511534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 155/302] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:18.537172 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00692fe6-8774-49f0-b2e0-28baef5048ee None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:18.660953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00692fe6-8774-49f0-b2e0-28baef5048ee None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:18.669134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:18.708562 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7555f-57b2-403d-96a1-228e150f925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:18.709206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7555f-57b2-403d-96a1-228e150f925c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.709484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7555f-57b2-403d-96a1-228e150f925c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.709754 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7555f-57b2-403d-96a1-228e150f925c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.729879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7555f-57b2-403d-96a1-228e150f925c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:18.733551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0655bc-417d-403c-87fd-f2584e324720 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c0b7555f-57b2-403d-96a1-228e150f925c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:18.734894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:18.735729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:18.736539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 148/303] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:18.743737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7555f-57b2-403d-96a1-228e150f925c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:18.907047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0655bc-417d-403c-87fd-f2584e324720 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:18.911680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7555f-57b2-403d-96a1-228e150f925c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:18.957799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aeb3c-44cf-4a93-a46d-9744d4d3c575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:18.960209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aeb3c-44cf-4a93-a46d-9744d4d3c575 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.960209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aeb3c-44cf-4a93-a46d-9744d4d3c575 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.960209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aeb3c-44cf-4a93-a46d-9744d4d3c575 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.968236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee45be-c995-4ece-9970-6b9d1a7a8712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:18.968875 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee45be-c995-4ece-9970-6b9d1a7a8712 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:18.969149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee45be-c995-4ece-9970-6b9d1a7a8712 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:18.969414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee45be-c995-4ece-9970-6b9d1a7a8712 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:18.970076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee45be-c995-4ece-9970-6b9d1a7a8712 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:18.970374 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee45be-c995-4ece-9970-6b9d1a7a8712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:18.971745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee45be-c995-4ece-9970-6b9d1a7a8712 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:18.983293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 149/304] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:18.983943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee45be-c995-4ece-9970-6b9d1a7a8712 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:18.989636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aeb3c-44cf-4a93-a46d-9744d4d3c575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-834aeb3c-44cf-4a93-a46d-9744d4d3c575 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:18.995613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:18.996977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 156/305] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:21:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:18.998030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aeb3c-44cf-4a93-a46d-9744d4d3c575 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:19.057155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:19.084280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:19.134993 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aeb3c-44cf-4a93-a46d-9744d4d3c575 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:19.147901 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee45be-c995-4ece-9970-6b9d1a7a8712 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:19.171614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dfd6f-f5d1-48aa-b81a-4eece320c929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:19.172143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dfd6f-f5d1-48aa-b81a-4eece320c929 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:19.172429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dfd6f-f5d1-48aa-b81a-4eece320c929 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:19.172731 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dfd6f-f5d1-48aa-b81a-4eece320c929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:19.193748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dff1d-b6b3-490e-9845-64fb3daa7e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:19.194694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dff1d-b6b3-490e-9845-64fb3daa7e04 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:19.195186 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dff1d-b6b3-490e-9845-64fb3daa7e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:19.195650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dff1d-b6b3-490e-9845-64fb3daa7e04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:19.208567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dff1d-b6b3-490e-9845-64fb3daa7e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c76dff1d-b6b3-490e-9845-64fb3daa7e04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:19.215633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:19.216543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 03:21:19.217324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:19.219568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 150/306] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:19.220930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dff1d-b6b3-490e-9845-64fb3daa7e04 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:19.259419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dfd6f-f5d1-48aa-b81a-4eece320c929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:19.261082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dfd6f-f5d1-48aa-b81a-4eece320c929 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:19.327167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:19.337436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:19.359388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dff1d-b6b3-490e-9845-64fb3daa7e04 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:19.403034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 157/307] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:19.407681 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dfd6f-f5d1-48aa-b81a-4eece320c929 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:19.410937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c207a5-d2d5-4417-8508-ce2380b07ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:19.411804 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c207a5-d2d5-4417-8508-ce2380b07ded None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:19.412222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c207a5-d2d5-4417-8508-ce2380b07ded None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:19.413632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c207a5-d2d5-4417-8508-ce2380b07ded None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:19.414455 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c207a5-d2d5-4417-8508-ce2380b07ded None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:19.414898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c207a5-d2d5-4417-8508-ce2380b07ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:19.416548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c207a5-d2d5-4417-8508-ce2380b07ded None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:19.426571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 151/308] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:19.427847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c207a5-d2d5-4417-8508-ce2380b07ded None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:19.538921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dfd6f-f5d1-48aa-b81a-4eece320c929 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:19.555062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c207a5-d2d5-4417-8508-ce2380b07ded None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:19.581815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268c15e-d7cd-4ff7-82b8-5c7e0c8651ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:19.582429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268c15e-d7cd-4ff7-82b8-5c7e0c8651ef None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:19.583467 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268c15e-d7cd-4ff7-82b8-5c7e0c8651ef None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:19.583467 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268c15e-d7cd-4ff7-82b8-5c7e0c8651ef None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:19.583661 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268c15e-d7cd-4ff7-82b8-5c7e0c8651ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:19.583918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268c15e-d7cd-4ff7-82b8-5c7e0c8651ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:19.585464 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268c15e-d7cd-4ff7-82b8-5c7e0c8651ef None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:19.593883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77e381-4b17-48c5-b99a-8994869521bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:19.594473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 158/309] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:21:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:19.594941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77e381-4b17-48c5-b99a-8994869521bd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:19.595304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268c15e-d7cd-4ff7-82b8-5c7e0c8651ef None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:19.595676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77e381-4b17-48c5-b99a-8994869521bd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:19.596087 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77e381-4b17-48c5-b99a-8994869521bd None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:19.597566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77e381-4b17-48c5-b99a-8994869521bd None admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:19.600582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77e381-4b17-48c5-b99a-8994869521bd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:19.602406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 152/310] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:21:19 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:19.603887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77e381-4b17-48c5-b99a-8994869521bd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:19.624938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:19.625646 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:19.724475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268c15e-d7cd-4ff7-82b8-5c7e0c8651ef None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:19.736623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77e381-4b17-48c5-b99a-8994869521bd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:19.777721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075666b1-4322-4c9e-980d-977c2668b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:19.778344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075666b1-4322-4c9e-980d-977c2668b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:19.778623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075666b1-4322-4c9e-980d-977c2668b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:19.778901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075666b1-4322-4c9e-980d-977c2668b0f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:19.780688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1108c27-a365-4183-b1e0-2b3aab7fc70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:19.781306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1108c27-a365-4183-b1e0-2b3aab7fc70b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:19.781591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1108c27-a365-4183-b1e0-2b3aab7fc70b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:19.781862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1108c27-a365-4183-b1e0-2b3aab7fc70b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:19.867115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1108c27-a365-4183-b1e0-2b3aab7fc70b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:19.867911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075666b1-4322-4c9e-980d-977c2668b0f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:19.868705 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1108c27-a365-4183-b1e0-2b3aab7fc70b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:19.870007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075666b1-4322-4c9e-980d-977c2668b0f3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:19.891816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:19.896024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:19.991718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 159/311] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:19.992543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075666b1-4322-4c9e-980d-977c2668b0f3 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:20.005069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 153/312] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:20.006751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f0706-0aa2-4f98-abb0-1e1cfeecb31d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:20.007045 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f0706-0aa2-4f98-abb0-1e1cfeecb31d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:20.007323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f0706-0aa2-4f98-abb0-1e1cfeecb31d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:20.008821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 154/313] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:20.010533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f0706-0aa2-4f98-abb0-1e1cfeecb31d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:20.119402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075666b1-4322-4c9e-980d-977c2668b0f3 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:20.144632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:20.162134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f0706-0aa2-4f98-abb0-1e1cfeecb31d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:20.163911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcff23-3164-4808-bcf7-df33d900bf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:20.164596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcff23-3164-4808-bcf7-df33d900bf08 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:20.164861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcff23-3164-4808-bcf7-df33d900bf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:20.165139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcff23-3164-4808-bcf7-df33d900bf08 None admin] PATH_INFO: `/v3/groups/3602ec51afaf46318dcfd97af88e7dfe` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:20.166297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcff23-3164-4808-bcf7-df33d900bf08 None admin] RBAC: Authorizing `identity:get_group(group_id=3602ec51afaf46318dcfd97af88e7dfe)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:20.167748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcff23-3164-4808-bcf7-df33d900bf08 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:20.169733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 160/314] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Nov 2 03:21:19 2022] GET /identity/v3/groups/3602ec51afaf46318dcfd97af88e7dfe => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:20.170287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcff23-3164-4808-bcf7-df33d900bf08 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:20.185477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:20.215340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8acb6a-2255-4152-a220-e464e802516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:20.215750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acb6a-2255-4152-a220-e464e802516d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:20.216036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acb6a-2255-4152-a220-e464e802516d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:20.216313 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acb6a-2255-4152-a220-e464e802516d None admin] PATH_INFO: `/v3/projects/a169391a6f324e26a7a0b1278ba35a09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:20.217493 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8acb6a-2255-4152-a220-e464e802516d None admin] RBAC: Authorizing `identity:get_project(project_id=a169391a6f324e26a7a0b1278ba35a09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:20.219344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8acb6a-2255-4152-a220-e464e802516d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:20.221656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 155/315] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:21:20 2022] GET /identity/v3/projects/a169391a6f324e26a7a0b1278ba35a09 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:20.222778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca4d26-01c7-4542-aab9-fdf828068de0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:20.223056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca4d26-01c7-4542-aab9-fdf828068de0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:20.223329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca4d26-01c7-4542-aab9-fdf828068de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:20.243459 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-94ca4d26-01c7-4542-aab9-fdf828068de0 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:20.248234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-94ca4d26-01c7-4542-aab9-fdf828068de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:20.301854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcff23-3164-4808-bcf7-df33d900bf08 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:20.333267 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 156/316] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:20.333645 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca4d26-01c7-4542-aab9-fdf828068de0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:20.341116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef9557-e2c0-4bdd-bebe-0bef1ebe8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:20.342020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9557-e2c0-4bdd-bebe-0bef1ebe8f35 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:20.342570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9557-e2c0-4bdd-bebe-0bef1ebe8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:20.343074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9557-e2c0-4bdd-bebe-0bef1ebe8f35 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:20.344558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef9557-e2c0-4bdd-bebe-0bef1ebe8f35 None admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:20.346356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef9557-e2c0-4bdd-bebe-0bef1ebe8f35 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:20.348587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 161/317] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:21:20 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:20.349626 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef9557-e2c0-4bdd-bebe-0bef1ebe8f35 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:20.417927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:20.450058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca4d26-01c7-4542-aab9-fdf828068de0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:20.468619 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:20.482694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef9557-e2c0-4bdd-bebe-0bef1ebe8f35 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:20.491094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e54514-b904-4825-9275-a13f9f943223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:20.491702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e54514-b904-4825-9275-a13f9f943223 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:20.491979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e54514-b904-4825-9275-a13f9f943223 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:20.492243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e54514-b904-4825-9275-a13f9f943223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:20.493076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e54514-b904-4825-9275-a13f9f943223 None admin] RBAC: Adding query filter params (group.id=3602ec51afaf46318dcfd97af88e7dfe, role.id=f36bf60d6adc430cb9cd4b01f399fa18, scope.project.id=a169391a6f324e26a7a0b1278ba35a09) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:20.493379 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e54514-b904-4825-9275-a13f9f943223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:20.495507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e54514-b904-4825-9275-a13f9f943223 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:20.506464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 157/318] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Nov 2 03:21:20 2022] GET /identity/v3/role_assignments?group.id=3602ec51afaf46318dcfd97af88e7dfe&scope.project.id=a169391a6f324e26a7a0b1278ba35a09&role.id=f36bf60d6adc430cb9cd4b01f399fa18 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:20.507499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e54514-b904-4825-9275-a13f9f943223 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:20.527515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ef534-f880-4baf-97f2-7f2262815b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:20.528955 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ef534-f880-4baf-97f2-7f2262815b62 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:20.529470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ef534-f880-4baf-97f2-7f2262815b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:20.530193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ef534-f880-4baf-97f2-7f2262815b62 None admin] PATH_INFO: `/v3/groups/3602ec51afaf46318dcfd97af88e7dfe` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:20.531641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ef534-f880-4baf-97f2-7f2262815b62 None admin] RBAC: Authorizing `identity:get_group(group_id=3602ec51afaf46318dcfd97af88e7dfe)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:20.533562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ef534-f880-4baf-97f2-7f2262815b62 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:20.536219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 162/319] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Nov 2 03:21:20 2022] GET /identity/v3/groups/3602ec51afaf46318dcfd97af88e7dfe => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:20.542428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ef534-f880-4baf-97f2-7f2262815b62 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:20.687627 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ef534-f880-4baf-97f2-7f2262815b62 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:20.717952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:20.722434 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e54514-b904-4825-9275-a13f9f943223 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:20.732546 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744701cf-7ee6-4b74-b76f-f50da83b5b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:20.733175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744701cf-7ee6-4b74-b76f-f50da83b5b59 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:20.733526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744701cf-7ee6-4b74-b76f-f50da83b5b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:20.733804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744701cf-7ee6-4b74-b76f-f50da83b5b59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:20.734552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744701cf-7ee6-4b74-b76f-f50da83b5b59 None admin] RBAC: Adding query filter params (group.id=3602ec51afaf46318dcfd97af88e7dfe, role.id=d36d8bd9f47e4ea8bef7f96d37d55d3c, scope.project.id=a169391a6f324e26a7a0b1278ba35a09) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:20.734867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744701cf-7ee6-4b74-b76f-f50da83b5b59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:20.736631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744701cf-7ee6-4b74-b76f-f50da83b5b59 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:20.744804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 163/320] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Nov 2 03:21:20 2022] GET /identity/v3/role_assignments?group.id=3602ec51afaf46318dcfd97af88e7dfe&scope.project.id=a169391a6f324e26a7a0b1278ba35a09&role.id=d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:20.745748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744701cf-7ee6-4b74-b76f-f50da83b5b59 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:20.771343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cdcad-c5a5-4335-9f59-e27b8b877b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:20.772403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cdcad-c5a5-4335-9f59-e27b8b877b43 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:20.772952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cdcad-c5a5-4335-9f59-e27b8b877b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:20.773423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cdcad-c5a5-4335-9f59-e27b8b877b43 None admin] PATH_INFO: `/v3/groups/3602ec51afaf46318dcfd97af88e7dfe` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:20.776008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cdcad-c5a5-4335-9f59-e27b8b877b43 None admin] RBAC: Authorizing `identity:get_group(group_id=3602ec51afaf46318dcfd97af88e7dfe)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:20.778021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cdcad-c5a5-4335-9f59-e27b8b877b43 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:20.779861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 158/321] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Nov 2 03:21:20 2022] GET /identity/v3/groups/3602ec51afaf46318dcfd97af88e7dfe => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:20.788488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cdcad-c5a5-4335-9f59-e27b8b877b43 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:20.880372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:20.911431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744701cf-7ee6-4b74-b76f-f50da83b5b59 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:20.963772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cdcad-c5a5-4335-9f59-e27b8b877b43 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:20.969782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aad5b-3853-4632-a0dd-b50d6accdf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:20.970444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aad5b-3853-4632-a0dd-b50d6accdf9f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:20.970727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aad5b-3853-4632-a0dd-b50d6accdf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:20.971001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aad5b-3853-4632-a0dd-b50d6accdf9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:20.988123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aad5b-3853-4632-a0dd-b50d6accdf9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-387aad5b-3853-4632-a0dd-b50d6accdf9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:20.995029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:20.996377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:21:20.998074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:21.000362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 164/322] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:21:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:21.002016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90890e8e-9235-4737-9bd0-f958df490863 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:21.002307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90890e8e-9235-4737-9bd0-f958df490863 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:21.002999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90890e8e-9235-4737-9bd0-f958df490863 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:21.004412 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 165/323] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:21.010042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90890e8e-9235-4737-9bd0-f958df490863 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:21.017306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb30c1-1dc4-46da-937b-5d24417994fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:21.017928 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb30c1-1dc4-46da-937b-5d24417994fd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:21.018210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb30c1-1dc4-46da-937b-5d24417994fd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:21.018487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb30c1-1dc4-46da-937b-5d24417994fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:21.019218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb30c1-1dc4-46da-937b-5d24417994fd None admin] RBAC: Adding query filter params (group.id=3602ec51afaf46318dcfd97af88e7dfe, role.id=f36bf60d6adc430cb9cd4b01f399fa18, scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:21.019529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb30c1-1dc4-46da-937b-5d24417994fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:21.021832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb30c1-1dc4-46da-937b-5d24417994fd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:21.028153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 159/324] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Nov 2 03:21:20 2022] GET /identity/v3/role_assignments?group.id=3602ec51afaf46318dcfd97af88e7dfe&scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b&role.id=f36bf60d6adc430cb9cd4b01f399fa18 => generated 611 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:21.029994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cfc3a-b0a7-45bc-8a99-c5e59bfdd95f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:21.030230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cfc3a-b0a7-45bc-8a99-c5e59bfdd95f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:21.030516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cfc3a-b0a7-45bc-8a99-c5e59bfdd95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:21.062738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aa2cfc3a-b0a7-45bc-8a99-c5e59bfdd95f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:21.063991 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa2cfc3a-b0a7-45bc-8a99-c5e59bfdd95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:21.091767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:21.155095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 160/325] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:21.175413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90890e8e-9235-4737-9bd0-f958df490863 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:21.220451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30461f-04c5-42b6-93e1-5799315fbbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:21.221493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30461f-04c5-42b6-93e1-5799315fbbdc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:21.221777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30461f-04c5-42b6-93e1-5799315fbbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:21.222049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30461f-04c5-42b6-93e1-5799315fbbdc None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:21.222733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30461f-04c5-42b6-93e1-5799315fbbdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:21.223039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30461f-04c5-42b6-93e1-5799315fbbdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:21.224497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30461f-04c5-42b6-93e1-5799315fbbdc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:21.234598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 166/326] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:21.240327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cfc3a-b0a7-45bc-8a99-c5e59bfdd95f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:21.291170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:21.354361 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cfc3a-b0a7-45bc-8a99-c5e59bfdd95f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:21.392526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dfeb4-ee2e-4c19-8beb-1157b639521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:21.393134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dfeb4-ee2e-4c19-8beb-1157b639521f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:21.393409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dfeb4-ee2e-4c19-8beb-1157b639521f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:21.393675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dfeb4-ee2e-4c19-8beb-1157b639521f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:21.437066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30461f-04c5-42b6-93e1-5799315fbbdc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:21.466407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204dfeb4-ee2e-4c19-8beb-1157b639521f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:21.467874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204dfeb4-ee2e-4c19-8beb-1157b639521f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:21.522475 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:21.560641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30461f-04c5-42b6-93e1-5799315fbbdc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:21.572521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:21.587071 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 161/327] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:21.592570 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dfeb4-ee2e-4c19-8beb-1157b639521f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:21.598950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a39e7-5780-4bb5-b618-30264b799e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:21.599581 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a39e7-5780-4bb5-b618-30264b799e30 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:21.599858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a39e7-5780-4bb5-b618-30264b799e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:21.600129 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a39e7-5780-4bb5-b618-30264b799e30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:21.612421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a39e7-5780-4bb5-b618-30264b799e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-803a39e7-5780-4bb5-b618-30264b799e30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:21.618072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:21.619824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 167/328] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:21:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:21.625166 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a39e7-5780-4bb5-b618-30264b799e30 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:21.715586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dfeb4-ee2e-4c19-8beb-1157b639521f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:21.747393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a39e7-5780-4bb5-b618-30264b799e30 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:21.755295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86d23-4f34-4e2e-ae3a-3537147bfc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:21.755928 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86d23-4f34-4e2e-ae3a-3537147bfc29 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:21.756206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86d23-4f34-4e2e-ae3a-3537147bfc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:21.756563 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86d23-4f34-4e2e-ae3a-3537147bfc29 None admin] PATH_INFO: `/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:21.758112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c86d23-4f34-4e2e-ae3a-3537147bfc29 None admin] RBAC: Authorizing `identity:get_project(project_id=e9ab9b9969c94aa28422c81ea6f32a2b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:21.760702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c86d23-4f34-4e2e-ae3a-3537147bfc29 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:21.763156 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 162/329] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:21:21 2022] GET /identity/v3/projects/e9ab9b9969c94aa28422c81ea6f32a2b => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:21.768589 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86d23-4f34-4e2e-ae3a-3537147bfc29 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:21.784584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:21.787112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ccb82-53eb-42dc-bd93-0f2d35750aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:21.787749 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ccb82-53eb-42dc-bd93-0f2d35750aaa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:21.788033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ccb82-53eb-42dc-bd93-0f2d35750aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:21.788349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ccb82-53eb-42dc-bd93-0f2d35750aaa None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:21.789076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ccb82-53eb-42dc-bd93-0f2d35750aaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:21.789381 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ccb82-53eb-42dc-bd93-0f2d35750aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:21.791320 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ccb82-53eb-42dc-bd93-0f2d35750aaa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:21.800598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 168/330] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:21.806196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ccb82-53eb-42dc-bd93-0f2d35750aaa None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:21.840926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:21.892134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86d23-4f34-4e2e-ae3a-3537147bfc29 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:21.917062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ccb82-53eb-42dc-bd93-0f2d35750aaa None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:21.930878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ed29-ae0d-4c3c-9398-4741791975d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:21.932165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ed29-ae0d-4c3c-9398-4741791975d6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:21.932446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ed29-ae0d-4c3c-9398-4741791975d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:21.932744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ed29-ae0d-4c3c-9398-4741791975d6 None admin] PATH_INFO: `/v3/groups/3602ec51afaf46318dcfd97af88e7dfe` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:21.933840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ed29-ae0d-4c3c-9398-4741791975d6 None admin] RBAC: Authorizing `identity:get_group(group_id=3602ec51afaf46318dcfd97af88e7dfe)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:21.935270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ed29-ae0d-4c3c-9398-4741791975d6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:21.936882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 163/331] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Nov 2 03:21:21 2022] GET /identity/v3/groups/3602ec51afaf46318dcfd97af88e7dfe => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:21.942699 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ed29-ae0d-4c3c-9398-4741791975d6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:21.950994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843ce74-d992-486b-bb72-d35be7a1e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:21.951599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843ce74-d992-486b-bb72-d35be7a1e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:21.951877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843ce74-d992-486b-bb72-d35be7a1e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:21.952146 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843ce74-d992-486b-bb72-d35be7a1e2c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:22.019077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843ce74-d992-486b-bb72-d35be7a1e2c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:22.020552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843ce74-d992-486b-bb72-d35be7a1e2c7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:22.022811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:22.046222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ed29-ae0d-4c3c-9398-4741791975d6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:22.051373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:22.082530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0db7c-b7dc-482f-9624-db7d9c018da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:22.083134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0db7c-b7dc-482f-9624-db7d9c018da9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:22.083416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0db7c-b7dc-482f-9624-db7d9c018da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:22.083687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0db7c-b7dc-482f-9624-db7d9c018da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:22.084404 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0db7c-b7dc-482f-9624-db7d9c018da9 None admin] RBAC: Adding query filter params (group.id=3602ec51afaf46318dcfd97af88e7dfe, role.id=d36d8bd9f47e4ea8bef7f96d37d55d3c, scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:22.084744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0db7c-b7dc-482f-9624-db7d9c018da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:22.086161 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0db7c-b7dc-482f-9624-db7d9c018da9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:22.093152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 164/332] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Nov 2 03:21:21 2022] GET /identity/v3/role_assignments?group.id=3602ec51afaf46318dcfd97af88e7dfe&scope.project.id=e9ab9b9969c94aa28422c81ea6f32a2b&role.id=d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:22.123251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 169/333] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 03:21:22.129103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0db7c-b7dc-482f-9624-db7d9c018da9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:22.240187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0db7c-b7dc-482f-9624-db7d9c018da9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:22.276106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0812fb-a98e-497e-913e-c5d502ca0f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:22.276763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0812fb-a98e-497e-913e-c5d502ca0f62 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:22.277042 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0812fb-a98e-497e-913e-c5d502ca0f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:22.277310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0812fb-a98e-497e-913e-c5d502ca0f62 None admin] PATH_INFO: `/v3/projects/d6472819eb36466497e7080c4f423ed7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:22.278418 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0812fb-a98e-497e-913e-c5d502ca0f62 None admin] RBAC: Authorizing `identity:get_project(project_id=d6472819eb36466497e7080c4f423ed7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:22.279837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0812fb-a98e-497e-913e-c5d502ca0f62 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:22.281466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 165/334] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:21:22 2022] GET /identity/v3/projects/d6472819eb36466497e7080c4f423ed7 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:22.287037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843ce74-d992-486b-bb72-d35be7a1e2c7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:22.390375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843ce74-d992-486b-bb72-d35be7a1e2c7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:22.420568 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:22.425711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29684335-30b2-4c3c-b51f-7377ed807345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:22.426510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29684335-30b2-4c3c-b51f-7377ed807345 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:22.426929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29684335-30b2-4c3c-b51f-7377ed807345 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:22.427336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29684335-30b2-4c3c-b51f-7377ed807345 None admin] PATH_INFO: `/v3/groups/0dac3e6fc90c4cbea902a78df6a61dc9` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:22.428575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29684335-30b2-4c3c-b51f-7377ed807345 None admin] RBAC: Authorizing `identity:get_group(group_id=0dac3e6fc90c4cbea902a78df6a61dc9)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:22.430036 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29684335-30b2-4c3c-b51f-7377ed807345 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:22.431917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 170/335] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Nov 2 03:21:22 2022] GET /identity/v3/groups/0dac3e6fc90c4cbea902a78df6a61dc9 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:22.437805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0812fb-a98e-497e-913e-c5d502ca0f62 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:22.451905 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:22.537193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0812fb-a98e-497e-913e-c5d502ca0f62 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:22.569831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38ba1-4598-423d-b546-985017628c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:22.570433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38ba1-4598-423d-b546-985017628c77 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:22.570713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38ba1-4598-423d-b546-985017628c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:22.570985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38ba1-4598-423d-b546-985017628c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:22.571706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38ba1-4598-423d-b546-985017628c77 None admin] RBAC: Adding query filter params (group.id=0dac3e6fc90c4cbea902a78df6a61dc9, role.id=9a4fa7f48c24440cae54bb4ec26b5b49, scope.project.id=d6472819eb36466497e7080c4f423ed7) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:22.572569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38ba1-4598-423d-b546-985017628c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:22.573991 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38ba1-4598-423d-b546-985017628c77 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:22.579513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 166/336] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Nov 2 03:21:22 2022] GET /identity/v3/role_assignments?group.id=0dac3e6fc90c4cbea902a78df6a61dc9&scope.project.id=d6472819eb36466497e7080c4f423ed7&role.id=9a4fa7f48c24440cae54bb4ec26b5b49 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:25.261008 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ee5d-99fe-402d-8879-fac295d6578b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:25.262020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ee5d-99fe-402d-8879-fac295d6578b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:25.262510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ee5d-99fe-402d-8879-fac295d6578b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:25.264317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 171/337] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:25.270066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1a30-73b1-475a-8e92-34b5a8b306ad None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:25.270899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1a30-73b1-475a-8e92-34b5a8b306ad None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:25.271374 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1a30-73b1-475a-8e92-34b5a8b306ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:25.277668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdd63a-1d13-467f-b33f-20c9ae5d5abb None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:25.278198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdd63a-1d13-467f-b33f-20c9ae5d5abb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:25.278770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdd63a-1d13-467f-b33f-20c9ae5d5abb None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:25.280529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 172/338] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:25.285638 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eca7e8-4583-4227-a019-d9582e7e2ae2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:25.286170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eca7e8-4583-4227-a019-d9582e7e2ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:25.286642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eca7e8-4583-4227-a019-d9582e7e2ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:25.309560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-357d1a30-73b1-475a-8e92-34b5a8b306ad None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:25.311096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-357d1a30-73b1-475a-8e92-34b5a8b306ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:25.322167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-39eca7e8-4583-4227-a019-d9582e7e2ae2 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:25.324182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-39eca7e8-4583-4227-a019-d9582e7e2ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:25.417194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 173/339] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:25.453411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 167/340] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:25.528594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84975f7-05e9-43a7-ab9a-156b4cbfc176 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:25.529116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84975f7-05e9-43a7-ab9a-156b4cbfc176 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:25.529563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84975f7-05e9-43a7-ab9a-156b4cbfc176 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:25.531073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 174/341] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:25.536715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00163c85-c754-4e58-b2a7-61b2ad9f68c0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:25.537002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00163c85-c754-4e58-b2a7-61b2ad9f68c0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:25.537279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00163c85-c754-4e58-b2a7-61b2ad9f68c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:25.549150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:25.562122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-00163c85-c754-4e58-b2a7-61b2ad9f68c0 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:25.563338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-00163c85-c754-4e58-b2a7-61b2ad9f68c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:25.647916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 168/342] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:25.810296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84975f7-05e9-43a7-ab9a-156b4cbfc176 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:25.851681 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00163c85-c754-4e58-b2a7-61b2ad9f68c0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:25.973403 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84975f7-05e9-43a7-ab9a-156b4cbfc176 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:26.019697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00163c85-c754-4e58-b2a7-61b2ad9f68c0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:26.029104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:26.036289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd614063-c821-4237-8568-f476be88a498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:26.036968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd614063-c821-4237-8568-f476be88a498 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.037418 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd614063-c821-4237-8568-f476be88a498 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.037698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd614063-c821-4237-8568-f476be88a498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.060672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd614063-c821-4237-8568-f476be88a498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:26.062240 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd614063-c821-4237-8568-f476be88a498 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:26.073909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e19a4-2fd6-469f-aacb-0b604f7ab6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:26.075078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e19a4-2fd6-469f-aacb-0b604f7ab6cd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.075578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e19a4-2fd6-469f-aacb-0b604f7ab6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.076041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e19a4-2fd6-469f-aacb-0b604f7ab6cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.078569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-fd614063-c821-4237-8568-f476be88a498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:26.084216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:26.085219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:26.086046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:26.086046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:26.086046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:26.086046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 175/343] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:26.086479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd614063-c821-4237-8568-f476be88a498 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:26.092556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e19a4-2fd6-469f-aacb-0b604f7ab6cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:26.094298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e19a4-2fd6-469f-aacb-0b604f7ab6cd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-700e19a4-2fd6-469f-aacb-0b604f7ab6cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:26.115560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:26.116432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:26.117336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:26.117336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:26.117336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:26.122715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 169/344] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:26.122715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e19a4-2fd6-469f-aacb-0b604f7ab6cd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:26.207632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd614063-c821-4237-8568-f476be88a498 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:26.235116 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e19a4-2fd6-469f-aacb-0b604f7ab6cd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:26.245334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fca6ee-93f6-46f2-879f-0a5173cae81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:26.245970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca6ee-93f6-46f2-879f-0a5173cae81b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.246257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca6ee-93f6-46f2-879f-0a5173cae81b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.246530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca6ee-93f6-46f2-879f-0a5173cae81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.257423 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fca6ee-93f6-46f2-879f-0a5173cae81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:26.258890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fca6ee-93f6-46f2-879f-0a5173cae81b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:26.271097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c62cc-b080-4cf1-a94b-b086b1b436d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:26.271706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c62cc-b080-4cf1-a94b-b086b1b436d3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.271982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c62cc-b080-4cf1-a94b-b086b1b436d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.272256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c62cc-b080-4cf1-a94b-b086b1b436d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.272924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c62cc-b080-4cf1-a94b-b086b1b436d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:26.273228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c62cc-b080-4cf1-a94b-b086b1b436d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-05fca6ee-93f6-46f2-879f-0a5173cae81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:26.274096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:26.275183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:26.277134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:26.277134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:26.277134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:26.277300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c62cc-b080-4cf1-a94b-b086b1b436d3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:26.277368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 176/345] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:26.277368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fca6ee-93f6-46f2-879f-0a5173cae81b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:26.294063 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 170/346] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:26.295682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191b0ba-8a6d-484e-a688-23d8a5e00009 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.295963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191b0ba-8a6d-484e-a688-23d8a5e00009 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.296230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191b0ba-8a6d-484e-a688-23d8a5e00009 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.300500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 171/347] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:26.300500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191b0ba-8a6d-484e-a688-23d8a5e00009 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:26.321298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:26.350690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:26.391796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fca6ee-93f6-46f2-879f-0a5173cae81b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:26.409065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191b0ba-8a6d-484e-a688-23d8a5e00009 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:26.425834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8eb8-9ff3-4e38-a9d3-da5f93c89e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:26.426571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8eb8-9ff3-4e38-a9d3-da5f93c89e34 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.426852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8eb8-9ff3-4e38-a9d3-da5f93c89e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.427130 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8eb8-9ff3-4e38-a9d3-da5f93c89e34 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.427783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba8eb8-9ff3-4e38-a9d3-da5f93c89e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:26.428088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba8eb8-9ff3-4e38-a9d3-da5f93c89e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:26.429499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba8eb8-9ff3-4e38-a9d3-da5f93c89e34 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:26.441389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 177/348] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:26.445944 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8eb8-9ff3-4e38-a9d3-da5f93c89e34 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:26.450445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316c3e2-4624-4def-be18-6bca2308318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:26.451424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c3e2-4624-4def-be18-6bca2308318b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.451704 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c3e2-4624-4def-be18-6bca2308318b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.451973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c3e2-4624-4def-be18-6bca2308318b None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.452650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c3e2-4624-4def-be18-6bca2308318b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:26.452951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c3e2-4624-4def-be18-6bca2308318b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:26.454432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c3e2-4624-4def-be18-6bca2308318b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:26.467546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 172/349] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:26.469774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4badbc4-8700-4a9c-a0b7-194e9837f468 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.470067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4badbc4-8700-4a9c-a0b7-194e9837f468 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.470351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4badbc4-8700-4a9c-a0b7-194e9837f468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.492226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c4badbc4-8700-4a9c-a0b7-194e9837f468 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:26.494580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c4badbc4-8700-4a9c-a0b7-194e9837f468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:26.543665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:26.551998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8eb8-9ff3-4e38-a9d3-da5f93c89e34 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:26.573715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 173/350] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:26.574363 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4badbc4-8700-4a9c-a0b7-194e9837f468 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:26.601909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc7f9-a036-4059-9082-c1521a9e41db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:26.602525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc7f9-a036-4059-9082-c1521a9e41db None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.602809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc7f9-a036-4059-9082-c1521a9e41db None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.603673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc7f9-a036-4059-9082-c1521a9e41db None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.604526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bc7f9-a036-4059-9082-c1521a9e41db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:26.606127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bc7f9-a036-4059-9082-c1521a9e41db None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:26.621297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:26.641187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 178/351] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:21:26 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:26.642703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc7f9-a036-4059-9082-c1521a9e41db None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:26.699853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4badbc4-8700-4a9c-a0b7-194e9837f468 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:26.745365 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bf1f0-1371-4858-b3aa-512760517e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:26.746127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bf1f0-1371-4858-b3aa-512760517e0d None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.746469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bf1f0-1371-4858-b3aa-512760517e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.746852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bf1f0-1371-4858-b3aa-512760517e0d None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.747541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bf1f0-1371-4858-b3aa-512760517e0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:26.753397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bf1f0-1371-4858-b3aa-512760517e0d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:26.775947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 174/352] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:21:26 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:26.846303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc7f9-a036-4059-9082-c1521a9e41db None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:26.851419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bf1f0-1371-4858-b3aa-512760517e0d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:26.892854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47242dce-2b01-4c67-b23f-fd03b606eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:26.893796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242dce-2b01-4c67-b23f-fd03b606eec8 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.894267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242dce-2b01-4c67-b23f-fd03b606eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.894741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242dce-2b01-4c67-b23f-fd03b606eec8 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.895595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47242dce-2b01-4c67-b23f-fd03b606eec8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:26.897354 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47242dce-2b01-4c67-b23f-fd03b606eec8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:26.924084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 179/353] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:21:26 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:26.925973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c24000-0e4f-4739-847b-dd0164857444 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.926554 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c24000-0e4f-4739-847b-dd0164857444 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.927002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c24000-0e4f-4739-847b-dd0164857444 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.929141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 180/354] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:26.938724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c269cc-46cf-4d25-8a58-06c40ad79af0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:26.938724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c269cc-46cf-4d25-8a58-06c40ad79af0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:26.938724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c269cc-46cf-4d25-8a58-06c40ad79af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:26.962106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:26.977580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-71c269cc-46cf-4d25-8a58-06c40ad79af0 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:26.980493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-71c269cc-46cf-4d25-8a58-06c40ad79af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:27.004532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:27.012798 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bf1f0-1371-4858-b3aa-512760517e0d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:27.067388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 181/355] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:21:27.074249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532cba4-f171-4f2d-8c20-7651f68788fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:27.074918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532cba4-f171-4f2d-8c20-7651f68788fc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:27.075202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532cba4-f171-4f2d-8c20-7651f68788fc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:27.075477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532cba4-f171-4f2d-8c20-7651f68788fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:27.088306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532cba4-f171-4f2d-8c20-7651f68788fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:27.089866 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532cba4-f171-4f2d-8c20-7651f68788fc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6532cba4-f171-4f2d-8c20-7651f68788fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:27.107466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:27.108557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:27.109464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:27.109464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:27.109464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:27.112587 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 175/356] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:27.115479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c269cc-46cf-4d25-8a58-06c40ad79af0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:27.225089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c269cc-46cf-4d25-8a58-06c40ad79af0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:27.261127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fdb00-b474-4de1-960e-6da00bac94bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:27.261736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fdb00-b474-4de1-960e-6da00bac94bd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:27.262016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fdb00-b474-4de1-960e-6da00bac94bd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:27.262353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fdb00-b474-4de1-960e-6da00bac94bd None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:27.263060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fdb00-b474-4de1-960e-6da00bac94bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:27.263362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fdb00-b474-4de1-960e-6da00bac94bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:27.264917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fdb00-b474-4de1-960e-6da00bac94bd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:27.267332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:27.282562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 182/357] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:27.285266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532cba4-f171-4f2d-8c20-7651f68788fc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:27.392648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532cba4-f171-4f2d-8c20-7651f68788fc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:27.406427 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fdb00-b474-4de1-960e-6da00bac94bd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:27.430319 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d36700-1526-423f-a7da-1279a33bbfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:27.431484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d36700-1526-423f-a7da-1279a33bbfb4 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:27.431780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d36700-1526-423f-a7da-1279a33bbfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:27.432057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d36700-1526-423f-a7da-1279a33bbfb4 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:27.432738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d36700-1526-423f-a7da-1279a33bbfb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:27.434247 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d36700-1526-423f-a7da-1279a33bbfb4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:27.460834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:27.465737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 176/358] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:21:27 2022] POST /identity/v3/users => generated 249 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:27.604301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fdb00-b474-4de1-960e-6da00bac94bd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:27.654548 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af7c3-2d97-4b87-af20-1624c2bcef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:27.655173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af7c3-2d97-4b87-af20-1624c2bcef33 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:27.655456 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af7c3-2d97-4b87-af20-1624c2bcef33 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:27.655729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af7c3-2d97-4b87-af20-1624c2bcef33 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:27.656423 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382af7c3-2d97-4b87-af20-1624c2bcef33 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:27.658010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382af7c3-2d97-4b87-af20-1624c2bcef33 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:27.669732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.sql.core [None req-382af7c3-2d97-4b87-af20-1624c2bcef33 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 03:21:27.669732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 03:21:27.669732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [parameters: {'id': '10f454a57acc434daa8c7a107e7ebdf3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 03:21:27.669732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81396) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-382af7c3-2d97-4b87-af20-1624c2bcef33 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application conn.query(q) Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result.read() Nov 02 03:21:27.687508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return ref.to_dict() Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 03:21:27.688428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application next(self.gen) Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application yield resource Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application next(self.gen) Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise self.value Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application session.commit() Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 03:21:27.689378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.session.flush() Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application compat.raise_( Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 03:21:27.690201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 03:21:27.691054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application conn.query(q) Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result.read() Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 03:21:27.691832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [parameters: {'id': '10f454a57acc434daa8c7a107e7ebdf3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:27.693800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 03:21:27.695768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:27.697773 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 183/359] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Nov 2 03:21:27 2022] POST /identity/v3/roles => generated 144 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:27.697922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d36700-1526-423f-a7da-1279a33bbfb4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:27.806085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d36700-1526-423f-a7da-1279a33bbfb4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:27.843886 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f8cc-520c-4253-b33c-7a62e84563cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:27.844553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f8cc-520c-4253-b33c-7a62e84563cc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:27.844838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f8cc-520c-4253-b33c-7a62e84563cc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:27.845111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f8cc-520c-4253-b33c-7a62e84563cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:27.857275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153f8cc-520c-4253-b33c-7a62e84563cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1153f8cc-520c-4253-b33c-7a62e84563cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:27.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:27.863937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 03:21:27.864994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:27.868592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 177/360] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:21:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:27.871592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af7c3-2d97-4b87-af20-1624c2bcef33 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:27.936234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:27.981764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af7c3-2d97-4b87-af20-1624c2bcef33 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:28.019991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e0c16-5621-40a5-95f7-e863ec60d242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:28.020643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e0c16-5621-40a5-95f7-e863ec60d242 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:28.020922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e0c16-5621-40a5-95f7-e863ec60d242 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:28.021194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e0c16-5621-40a5-95f7-e863ec60d242 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:28.022029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e0c16-5621-40a5-95f7-e863ec60d242 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:28.022340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e0c16-5621-40a5-95f7-e863ec60d242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:28.023765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e0c16-5621-40a5-95f7-e863ec60d242 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:28.041899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 184/361] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:29.511017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138ddb7-31a5-487f-af84-7814c90f3023 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:29.512311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138ddb7-31a5-487f-af84-7814c90f3023 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:29.512823 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138ddb7-31a5-487f-af84-7814c90f3023 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:29.514604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 178/362] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:29.519975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f6b0-ae5a-4734-b184-263fbac79f2e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:29.520803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f6b0-ae5a-4734-b184-263fbac79f2e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:29.521291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f6b0-ae5a-4734-b184-263fbac79f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:29.531689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1e48-3cd1-4413-8760-47656735c864 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:29.532258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1e48-3cd1-4413-8760-47656735c864 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:29.532760 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1e48-3cd1-4413-8760-47656735c864 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:29.534474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 179/363] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:29.539045 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70497b5-afa0-4097-a34a-ac9e0623049f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:29.539332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70497b5-afa0-4097-a34a-ac9e0623049f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:29.539610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70497b5-afa0-4097-a34a-ac9e0623049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:29.546181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d961f6b0-ae5a-4734-b184-263fbac79f2e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:29.547592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d961f6b0-ae5a-4734-b184-263fbac79f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:29.576493 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b70497b5-afa0-4097-a34a-ac9e0623049f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:29.576493 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b70497b5-afa0-4097-a34a-ac9e0623049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:29.638484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 185/364] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:29.673282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:29.685769 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 180/365] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:21:29.830179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16184-5978-46e6-b821-9471cbb2141a None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:29.830463 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16184-5978-46e6-b821-9471cbb2141a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:29.830650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16184-5978-46e6-b821-9471cbb2141a None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:29.832250 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 186/366] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:29.837118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3e93f-2343-455c-afed-eb2121c06c19 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:29.837731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3e93f-2343-455c-afed-eb2121c06c19 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:29.838205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3e93f-2343-455c-afed-eb2121c06c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:29.861463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-51b3e93f-2343-455c-afed-eb2121c06c19 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:29.862642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-51b3e93f-2343-455c-afed-eb2121c06c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:29.951067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 181/367] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:29.967399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca16184-5978-46e6-b821-9471cbb2141a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:30.023680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:30.075305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca16184-5978-46e6-b821-9471cbb2141a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:30.110477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b63ad-0d3d-46c2-b873-d9f1bf9597ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:30.111035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b63ad-0d3d-46c2-b873-d9f1bf9597ca None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.111313 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b63ad-0d3d-46c2-b873-d9f1bf9597ca None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.111584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b63ad-0d3d-46c2-b873-d9f1bf9597ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.122325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b63ad-0d3d-46c2-b873-d9f1bf9597ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:30.124056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3e93f-2343-455c-afed-eb2121c06c19 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-1d6b63ad-0d3d-46c2-b873-d9f1bf9597ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:30.136047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:30.136992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:30.137775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:30.145221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 187/368] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:30.146730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b63ad-0d3d-46c2-b873-d9f1bf9597ca None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:30.288555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b63ad-0d3d-46c2-b873-d9f1bf9597ca None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:30.316861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:30.325782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea77b-5f4b-4ed1-b13c-cd25da7d2ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:30.326298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea77b-5f4b-4ed1-b13c-cd25da7d2ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.326579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea77b-5f4b-4ed1-b13c-cd25da7d2ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.326950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea77b-5f4b-4ed1-b13c-cd25da7d2ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.327722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ea77b-5f4b-4ed1-b13c-cd25da7d2ce7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:30.328024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ea77b-5f4b-4ed1-b13c-cd25da7d2ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:30.329439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ea77b-5f4b-4ed1-b13c-cd25da7d2ce7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:30.330389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3e93f-2343-455c-afed-eb2121c06c19 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:30.341476 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 188/369] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:30.342340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea77b-5f4b-4ed1-b13c-cd25da7d2ce7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:30.352657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:30.371857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328368-09ca-41c9-b537-93292a1f0808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:30.372424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328368-09ca-41c9-b537-93292a1f0808 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.372734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328368-09ca-41c9-b537-93292a1f0808 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.373010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328368-09ca-41c9-b537-93292a1f0808 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.385136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc328368-09ca-41c9-b537-93292a1f0808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bc328368-09ca-41c9-b537-93292a1f0808 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:30.390328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:30.391206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:30.392350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 182/370] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:30.393367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328368-09ca-41c9-b537-93292a1f0808 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:30.468298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea77b-5f4b-4ed1-b13c-cd25da7d2ce7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:30.504684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f25db-d105-4196-8cb6-265fd8a5b104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:30.505322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f25db-d105-4196-8cb6-265fd8a5b104 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.505607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f25db-d105-4196-8cb6-265fd8a5b104 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.505888 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f25db-d105-4196-8cb6-265fd8a5b104 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.512058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328368-09ca-41c9-b537-93292a1f0808 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:30.517372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f25db-d105-4196-8cb6-265fd8a5b104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f47f25db-d105-4196-8cb6-265fd8a5b104 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:30.522744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:30.524006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 189/371] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:30.525309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249df1c-ebf4-42da-9b90-13167f15fa42 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.526122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249df1c-ebf4-42da-9b90-13167f15fa42 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.526122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249df1c-ebf4-42da-9b90-13167f15fa42 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.527077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 190/372] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:30.527774 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249df1c-ebf4-42da-9b90-13167f15fa42 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:30.557246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061d134-269a-4e4f-b712-c73bb8bd01cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:30.558048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061d134-269a-4e4f-b712-c73bb8bd01cf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.558290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061d134-269a-4e4f-b712-c73bb8bd01cf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.558564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061d134-269a-4e4f-b712-c73bb8bd01cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.565670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:30.572015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061d134-269a-4e4f-b712-c73bb8bd01cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:30.573563 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061d134-269a-4e4f-b712-c73bb8bd01cf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b061d134-269a-4e4f-b712-c73bb8bd01cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:30.590314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:30.591243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:30.596876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:30.596876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:30.596876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:30.596876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 183/373] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:30.596876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061d134-269a-4e4f-b712-c73bb8bd01cf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:30.629805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:30.642603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249df1c-ebf4-42da-9b90-13167f15fa42 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:30.677329 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1bdd5-5ccf-4b56-bc12-24448093fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:30.677949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1bdd5-5ccf-4b56-bc12-24448093fca3 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.678231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1bdd5-5ccf-4b56-bc12-24448093fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.678506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1bdd5-5ccf-4b56-bc12-24448093fca3 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.679169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1bdd5-5ccf-4b56-bc12-24448093fca3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:30.679471 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1bdd5-5ccf-4b56-bc12-24448093fca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:30.680997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1bdd5-5ccf-4b56-bc12-24448093fca3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:30.689336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 191/374] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:30.690515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa9ba-6649-4627-9854-164811fae8b3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.690801 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa9ba-6649-4627-9854-164811fae8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.691076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa9ba-6649-4627-9854-164811fae8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.711775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ab8fa9ba-6649-4627-9854-164811fae8b3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:30.714325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ab8fa9ba-6649-4627-9854-164811fae8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:30.716448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061d134-269a-4e4f-b712-c73bb8bd01cf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:30.756254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5985d2-068a-48f4-ab65-840a17058548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:30.757205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5985d2-068a-48f4-ab65-840a17058548 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.757752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5985d2-068a-48f4-ab65-840a17058548 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.758028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5985d2-068a-48f4-ab65-840a17058548 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.758785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5985d2-068a-48f4-ab65-840a17058548 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:30.759669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5985d2-068a-48f4-ab65-840a17058548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:30.761298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5985d2-068a-48f4-ab65-840a17058548 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:30.779651 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 184/375] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:30.779651 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5985d2-068a-48f4-ab65-840a17058548 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:30.800484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 192/376] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:30.800484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fa9ba-6649-4627-9854-164811fae8b3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:30.831108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:30.893579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:30.902082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5985d2-068a-48f4-ab65-840a17058548 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:30.912486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fa9ba-6649-4627-9854-164811fae8b3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:30.940782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3eaf7-d83a-47a5-a9a1-c43833a143f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:30.941384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3eaf7-d83a-47a5-a9a1-c43833a143f2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.941706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3eaf7-d83a-47a5-a9a1-c43833a143f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.941925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3eaf7-d83a-47a5-a9a1-c43833a143f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.942573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3eaf7-d83a-47a5-a9a1-c43833a143f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:30.942853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3eaf7-d83a-47a5-a9a1-c43833a143f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:30.944210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3eaf7-d83a-47a5-a9a1-c43833a143f2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:30.947496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638678fa-4dfa-4097-80d6-583e6e8c88df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:30.948205 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638678fa-4dfa-4097-80d6-583e6e8c88df None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.948598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638678fa-4dfa-4097-80d6-583e6e8c88df None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.948880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638678fa-4dfa-4097-80d6-583e6e8c88df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.960282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 185/377] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:30.960282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3eaf7-d83a-47a5-a9a1-c43833a143f2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:30.960551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638678fa-4dfa-4097-80d6-583e6e8c88df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:30.961556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638678fa-4dfa-4097-80d6-583e6e8c88df None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-638678fa-4dfa-4097-80d6-583e6e8c88df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:30.977232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:30.978601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:30.979421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:30.979421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:30.979421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:30.979421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 193/378] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:30.979645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaebb85-30f7-4124-adf3-bf74ab3c9839 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:30.979894 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaebb85-30f7-4124-adf3-bf74ab3c9839 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:30.980053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaebb85-30f7-4124-adf3-bf74ab3c9839 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:30.981304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 194/379] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:30.985516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaebb85-30f7-4124-adf3-bf74ab3c9839 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.070757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:31.078816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3eaf7-d83a-47a5-a9a1-c43833a143f2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.094502 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaebb85-30f7-4124-adf3-bf74ab3c9839 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.113449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fc650-e419-48dd-8df5-1acecbe465cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.114077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc650-e419-48dd-8df5-1acecbe465cd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.114356 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc650-e419-48dd-8df5-1acecbe465cd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.114893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc650-e419-48dd-8df5-1acecbe465cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.125089 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fc650-e419-48dd-8df5-1acecbe465cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:31.126526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fc650-e419-48dd-8df5-1acecbe465cd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:31.133511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df8299-db7f-4fc3-9039-27a31ea21a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.134161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df8299-db7f-4fc3-9039-27a31ea21a7a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.134443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df8299-db7f-4fc3-9039-27a31ea21a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.134715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df8299-db7f-4fc3-9039-27a31ea21a7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fd9fc650-e419-48dd-8df5-1acecbe465cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:31.141028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:31.141922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:31.142779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:31.142779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:31.142779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:31.142936 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df8299-db7f-4fc3-9039-27a31ea21a7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:31.143002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 186/380] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:31.143064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df8299-db7f-4fc3-9039-27a31ea21a7a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:31.143690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fc650-e419-48dd-8df5-1acecbe465cd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.153565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-27df8299-db7f-4fc3-9039-27a31ea21a7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:31.157316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:31.158355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:31.159217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 195/381] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Nov 2 03:21:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:31.160147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820f48-98cb-45a9-a7de-11fb103b2b0b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.160340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820f48-98cb-45a9-a7de-11fb103b2b0b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.160624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820f48-98cb-45a9-a7de-11fb103b2b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.178432 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-86820f48-98cb-45a9-a7de-11fb103b2b0b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:31.179561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-86820f48-98cb-45a9-a7de-11fb103b2b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:31.246551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 196/382] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:31.247373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820f48-98cb-45a9-a7de-11fb103b2b0b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.261259 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fc650-e419-48dd-8df5-1acecbe465cd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.297823 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5f79b-c37a-4007-8ea1-f8432775bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.298573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5f79b-c37a-4007-8ea1-f8432775bea5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.298878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5f79b-c37a-4007-8ea1-f8432775bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.299123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5f79b-c37a-4007-8ea1-f8432775bea5 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.299921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5f79b-c37a-4007-8ea1-f8432775bea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:31.300224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5f79b-c37a-4007-8ea1-f8432775bea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:31.301861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5f79b-c37a-4007-8ea1-f8432775bea5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:31.315691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 187/383] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:31.316359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5f79b-c37a-4007-8ea1-f8432775bea5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.322899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:31.360045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820f48-98cb-45a9-a7de-11fb103b2b0b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.386350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:31.398161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e599de-f52c-4f95-a718-d44de2481c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.398728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e599de-f52c-4f95-a718-d44de2481c15 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.399012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e599de-f52c-4f95-a718-d44de2481c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.399279 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e599de-f52c-4f95-a718-d44de2481c15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.410376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e599de-f52c-4f95-a718-d44de2481c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-91e599de-f52c-4f95-a718-d44de2481c15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:31.415780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:31.416711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:31.417528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 197/384] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:31.418172 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e599de-f52c-4f95-a718-d44de2481c15 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.428814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5f79b-c37a-4007-8ea1-f8432775bea5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.465800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c859624-ba89-426c-9f70-9534bdc2d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.466403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859624-ba89-426c-9f70-9534bdc2d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.466686 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859624-ba89-426c-9f70-9534bdc2d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.466956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c859624-ba89-426c-9f70-9534bdc2d0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.467590 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c859624-ba89-426c-9f70-9534bdc2d0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:31.468064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c859624-ba89-426c-9f70-9534bdc2d0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:31.469267 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c859624-ba89-426c-9f70-9534bdc2d0f8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:31.485406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 188/385] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:31.485406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c859624-ba89-426c-9f70-9534bdc2d0f8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.535790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e599de-f52c-4f95-a718-d44de2481c15 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.562600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:31.570784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31f2e9-0ce5-4551-84d2-0a321a87d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.571493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31f2e9-0ce5-4551-84d2-0a321a87d463 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.571741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31f2e9-0ce5-4551-84d2-0a321a87d463 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.572051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31f2e9-0ce5-4551-84d2-0a321a87d463 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.572740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31f2e9-0ce5-4551-84d2-0a321a87d463 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:31.573043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31f2e9-0ce5-4551-84d2-0a321a87d463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:31.574469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31f2e9-0ce5-4551-84d2-0a321a87d463 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:31.587775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c859624-ba89-426c-9f70-9534bdc2d0f8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.610647 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 198/386] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:31.611469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31f2e9-0ce5-4551-84d2-0a321a87d463 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.617943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:31.627461 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f240e-0cfd-4349-8267-8b856720a37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.628091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f240e-0cfd-4349-8267-8b856720a37a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.628375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f240e-0cfd-4349-8267-8b856720a37a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.628680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f240e-0cfd-4349-8267-8b856720a37a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.636258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f240e-0cfd-4349-8267-8b856720a37a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:31.637724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f240e-0cfd-4349-8267-8b856720a37a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-be2f240e-0cfd-4349-8267-8b856720a37a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:31.650721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:31.651616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 189/387] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:31.652969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f240e-0cfd-4349-8267-8b856720a37a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.710875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31f2e9-0ce5-4551-84d2-0a321a87d463 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.745312 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c0455-2990-45f3-a1de-cd1b63090cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.745942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c0455-2990-45f3-a1de-cd1b63090cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.746222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c0455-2990-45f3-a1de-cd1b63090cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.746491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c0455-2990-45f3-a1de-cd1b63090cf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.747142 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c0455-2990-45f3-a1de-cd1b63090cf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:31.747437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c0455-2990-45f3-a1de-cd1b63090cf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:31.748832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c0455-2990-45f3-a1de-cd1b63090cf8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:31.751765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f240e-0cfd-4349-8267-8b856720a37a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.756368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 199/388] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:31.757173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c0455-2990-45f3-a1de-cd1b63090cf8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.789556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057f4e0-524a-47b1-9584-1b8536a34545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.791075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057f4e0-524a-47b1-9584-1b8536a34545 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.791458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057f4e0-524a-47b1-9584-1b8536a34545 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.791742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057f4e0-524a-47b1-9584-1b8536a34545 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.798947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057f4e0-524a-47b1-9584-1b8536a34545 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:31.800379 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057f4e0-524a-47b1-9584-1b8536a34545 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:31.809012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a057f4e0-524a-47b1-9584-1b8536a34545 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:31.811780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:31.812743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:31.813595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 190/389] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:31.816405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057f4e0-524a-47b1-9584-1b8536a34545 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.861663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:31.863858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c0455-2990-45f3-a1de-cd1b63090cf8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.897445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808bbd3-30fa-4589-bad2-71d05a087fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.898066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808bbd3-30fa-4589-bad2-71d05a087fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.898344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808bbd3-30fa-4589-bad2-71d05a087fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.898614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808bbd3-30fa-4589-bad2-71d05a087fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.909357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808bbd3-30fa-4589-bad2-71d05a087fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:31.910739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808bbd3-30fa-4589-bad2-71d05a087fe0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:31.914100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057f4e0-524a-47b1-9584-1b8536a34545 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-0808bbd3-30fa-4589-bad2-71d05a087fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:31.924559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:31.925643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:31.926851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:31.926851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:31.926851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:31.926851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 200/390] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:31.926851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808bbd3-30fa-4589-bad2-71d05a087fe0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:31.950093 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5966a-4a21-42d6-910c-c2710e150913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:31.950713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5966a-4a21-42d6-910c-c2710e150913 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:31.950989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5966a-4a21-42d6-910c-c2710e150913 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:31.951260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5966a-4a21-42d6-910c-c2710e150913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:31.961630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5966a-4a21-42d6-910c-c2710e150913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:31.963766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5966a-4a21-42d6-910c-c2710e150913 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ead5966a-4a21-42d6-910c-c2710e150913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:31.977694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:31.983274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:31.984139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:31.984139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:31.984139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:31.984139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 191/391] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:31.984139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5966a-4a21-42d6-910c-c2710e150913 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.023818 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:32.027131 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808bbd3-30fa-4589-bad2-71d05a087fe0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.063503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d8701-ac0d-4ac6-9248-5f8d35d6dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.064114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d8701-ac0d-4ac6-9248-5f8d35d6dc35 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.064393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d8701-ac0d-4ac6-9248-5f8d35d6dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.064698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d8701-ac0d-4ac6-9248-5f8d35d6dc35 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.065416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d8701-ac0d-4ac6-9248-5f8d35d6dc35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:32.065721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d8701-ac0d-4ac6-9248-5f8d35d6dc35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.067145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d8701-ac0d-4ac6-9248-5f8d35d6dc35 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.089855 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:32.093462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 201/392] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:32.094209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5966a-4a21-42d6-910c-c2710e150913 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.094312 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d8701-ac0d-4ac6-9248-5f8d35d6dc35 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.129888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e43f1-48ad-445b-acef-9527dea61462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.130510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e43f1-48ad-445b-acef-9527dea61462 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.130787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e43f1-48ad-445b-acef-9527dea61462 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.131058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e43f1-48ad-445b-acef-9527dea61462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.142001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e43f1-48ad-445b-acef-9527dea61462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.143440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e43f1-48ad-445b-acef-9527dea61462 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c41e43f1-48ad-445b-acef-9527dea61462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:32.157104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:32.158160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:32.158976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:32.158976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:32.158976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:32.158976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 192/393] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:32.159281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e43f1-48ad-445b-acef-9527dea61462 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.194070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d8701-ac0d-4ac6-9248-5f8d35d6dc35 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.228183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfc778-e7e9-4dde-b293-fd7a27a7ff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.228809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfc778-e7e9-4dde-b293-fd7a27a7ff8a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.229090 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfc778-e7e9-4dde-b293-fd7a27a7ff8a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.229358 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfc778-e7e9-4dde-b293-fd7a27a7ff8a None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.230072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfc778-e7e9-4dde-b293-fd7a27a7ff8a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:32.230375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfc778-e7e9-4dde-b293-fd7a27a7ff8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.231797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfc778-e7e9-4dde-b293-fd7a27a7ff8a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.249283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 202/394] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Nov 2 03:21:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:32.250165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfc778-e7e9-4dde-b293-fd7a27a7ff8a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.259001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e43f1-48ad-445b-acef-9527dea61462 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.267916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:32.299582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d78b-9e24-406f-b2f4-fd9518613bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.300660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d78b-9e24-406f-b2f4-fd9518613bbe None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.301151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d78b-9e24-406f-b2f4-fd9518613bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.301618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d78b-9e24-406f-b2f4-fd9518613bbe None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.302541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d78b-9e24-406f-b2f4-fd9518613bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:32.302896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d78b-9e24-406f-b2f4-fd9518613bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.304280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d78b-9e24-406f-b2f4-fd9518613bbe None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.317164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 193/395] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:32.317992 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d78b-9e24-406f-b2f4-fd9518613bbe None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.330213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:32.351742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfc778-e7e9-4dde-b293-fd7a27a7ff8a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.386200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2b184-cf46-402a-9b17-1c182ca4539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.386802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b184-cf46-402a-9b17-1c182ca4539b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.387084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b184-cf46-402a-9b17-1c182ca4539b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.387355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b184-cf46-402a-9b17-1c182ca4539b None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.387991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2b184-cf46-402a-9b17-1c182ca4539b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:32.388295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2b184-cf46-402a-9b17-1c182ca4539b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.389713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2b184-cf46-402a-9b17-1c182ca4539b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.401614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 203/396] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:32.402950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2b184-cf46-402a-9b17-1c182ca4539b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.421688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d78b-9e24-406f-b2f4-fd9518613bbe None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.455210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb60ae8-c472-46e3-acc2-b4e6a9e17493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.455985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb60ae8-c472-46e3-acc2-b4e6a9e17493 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.456367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb60ae8-c472-46e3-acc2-b4e6a9e17493 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.456766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb60ae8-c472-46e3-acc2-b4e6a9e17493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.467233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb60ae8-c472-46e3-acc2-b4e6a9e17493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.468714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb60ae8-c472-46e3-acc2-b4e6a9e17493 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.477963 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4cb60ae8-c472-46e3-acc2-b4e6a9e17493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:32.485008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:32.486067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:32.491995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:32.491995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:32.491995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:32.491995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 194/397] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:32.491995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb60ae8-c472-46e3-acc2-b4e6a9e17493 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.501899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2b184-cf46-402a-9b17-1c182ca4539b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.535605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55702b2f-8699-419d-aa63-43d67883b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.536311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55702b2f-8699-419d-aa63-43d67883b543 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.536885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55702b2f-8699-419d-aa63-43d67883b543 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.536885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55702b2f-8699-419d-aa63-43d67883b543 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.537500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55702b2f-8699-419d-aa63-43d67883b543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:32.537800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55702b2f-8699-419d-aa63-43d67883b543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.539170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55702b2f-8699-419d-aa63-43d67883b543 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.549892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:32.550628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 204/398] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:32.551388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55702b2f-8699-419d-aa63-43d67883b543 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.594577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb60ae8-c472-46e3-acc2-b4e6a9e17493 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.628141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84eee6-0541-400c-aa31-dc6d11cfc44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.628808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84eee6-0541-400c-aa31-dc6d11cfc44d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.629084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84eee6-0541-400c-aa31-dc6d11cfc44d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.629355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84eee6-0541-400c-aa31-dc6d11cfc44d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.640019 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84eee6-0541-400c-aa31-dc6d11cfc44d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.641501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84eee6-0541-400c-aa31-dc6d11cfc44d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.651032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55702b2f-8699-419d-aa63-43d67883b543 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5a84eee6-0541-400c-aa31-dc6d11cfc44d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:32.655995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:32.657085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:32.658005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:32.658005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:32.658005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:32.658005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 195/399] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:32.658294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84eee6-0541-400c-aa31-dc6d11cfc44d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.685128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aefd3e-791f-412d-ada9-7c67761b2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.685728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aefd3e-791f-412d-ada9-7c67761b2259 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.686018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aefd3e-791f-412d-ada9-7c67761b2259 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.686285 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aefd3e-791f-412d-ada9-7c67761b2259 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.686916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aefd3e-791f-412d-ada9-7c67761b2259 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.688344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aefd3e-791f-412d-ada9-7c67761b2259 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.697116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:32.710946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 205/400] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:21:32 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:32.711672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aefd3e-791f-412d-ada9-7c67761b2259 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.779310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84eee6-0541-400c-aa31-dc6d11cfc44d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.796452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:32.824120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ede4c-3fa2-4d60-b79e-e3a37bf50e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.824890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ede4c-3fa2-4d60-b79e-e3a37bf50e39 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.825571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ede4c-3fa2-4d60-b79e-e3a37bf50e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.825899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ede4c-3fa2-4d60-b79e-e3a37bf50e39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.835197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aefd3e-791f-412d-ada9-7c67761b2259 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:32.835390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ede4c-3fa2-4d60-b79e-e3a37bf50e39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.835752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ede4c-3fa2-4d60-b79e-e3a37bf50e39 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ed4ede4c-3fa2-4d60-b79e-e3a37bf50e39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:32.848778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:32.849834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:32.856153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:32.856153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:32.856153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:32.856153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:32.856153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:32.856153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:32.856153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:32.856153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:32.856153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 196/401] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:32.856153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ede4c-3fa2-4d60-b79e-e3a37bf50e39 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.884702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae319ea-fdae-4927-b86c-fb52e9bdb9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:32.885418 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae319ea-fdae-4927-b86c-fb52e9bdb9db None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:32.885701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae319ea-fdae-4927-b86c-fb52e9bdb9db None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:32.886093 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae319ea-fdae-4927-b86c-fb52e9bdb9db None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:32.886636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae319ea-fdae-4927-b86c-fb52e9bdb9db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:32.886940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae319ea-fdae-4927-b86c-fb52e9bdb9db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:32.888333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae319ea-fdae-4927-b86c-fb52e9bdb9db None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:32.901820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 206/402] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:32.902718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae319ea-fdae-4927-b86c-fb52e9bdb9db None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:32.962460 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:32.967552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ede4c-3fa2-4d60-b79e-e3a37bf50e39 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.004323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca059d-cc96-4f95-b583-85651e76e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.004985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca059d-cc96-4f95-b583-85651e76e78c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.005262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca059d-cc96-4f95-b583-85651e76e78c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.005603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca059d-cc96-4f95-b583-85651e76e78c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.013915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca059d-cc96-4f95-b583-85651e76e78c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.014716 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae319ea-fdae-4927-b86c-fb52e9bdb9db None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.015350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca059d-cc96-4f95-b583-85651e76e78c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-74ca059d-cc96-4f95-b583-85651e76e78c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:33.027915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:33.028889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 197/403] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:33.029766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca059d-cc96-4f95-b583-85651e76e78c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:33.062553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c452d4-3d39-4f72-9112-8a655dbec000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.063162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c452d4-3d39-4f72-9112-8a655dbec000 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.063440 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c452d4-3d39-4f72-9112-8a655dbec000 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.063712 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c452d4-3d39-4f72-9112-8a655dbec000 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.064355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c452d4-3d39-4f72-9112-8a655dbec000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:33.064697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c452d4-3d39-4f72-9112-8a655dbec000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.066065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c452d4-3d39-4f72-9112-8a655dbec000 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.071058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:33.077810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 207/404] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:33.083248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c452d4-3d39-4f72-9112-8a655dbec000 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:33.146519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca059d-cc96-4f95-b583-85651e76e78c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.187285 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bc9b3-9e25-4a63-a52e-e990514547c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.187888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bc9b3-9e25-4a63-a52e-e990514547c1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.188168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bc9b3-9e25-4a63-a52e-e990514547c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.188449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bc9b3-9e25-4a63-a52e-e990514547c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.189151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bc9b3-9e25-4a63-a52e-e990514547c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:33.189455 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bc9b3-9e25-4a63-a52e-e990514547c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.190859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bc9b3-9e25-4a63-a52e-e990514547c1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.192848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c452d4-3d39-4f72-9112-8a655dbec000 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.207090 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:33.209386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 198/405] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:33.210227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bc9b3-9e25-4a63-a52e-e990514547c1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:33.235066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161bad-9799-499a-905c-073bbe1b3e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.235938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161bad-9799-499a-905c-073bbe1b3e2d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.236222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161bad-9799-499a-905c-073bbe1b3e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.236601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161bad-9799-499a-905c-073bbe1b3e2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.244043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74161bad-9799-499a-905c-073bbe1b3e2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.245591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74161bad-9799-499a-905c-073bbe1b3e2d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-74161bad-9799-499a-905c-073bbe1b3e2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:33.261104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:33.261943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:33.262765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:33.262765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:33.262765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:33.262765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:33.262765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:33.262765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:33.262765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:33.262765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:33.262765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 208/406] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:33.268820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161bad-9799-499a-905c-073bbe1b3e2d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:33.314503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:33.322288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bc9b3-9e25-4a63-a52e-e990514547c1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.358794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4249897-b0f9-4d67-8bd6-92e376de34d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.359393 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4249897-b0f9-4d67-8bd6-92e376de34d4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.359669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4249897-b0f9-4d67-8bd6-92e376de34d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.359941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4249897-b0f9-4d67-8bd6-92e376de34d4 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.360684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4249897-b0f9-4d67-8bd6-92e376de34d4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:33.360989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4249897-b0f9-4d67-8bd6-92e376de34d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.362401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4249897-b0f9-4d67-8bd6-92e376de34d4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.370636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161bad-9799-499a-905c-073bbe1b3e2d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.401384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 199/407] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Nov 2 03:21:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:33.405007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e59455-7801-4cd6-80c7-926ca83dba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.405727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e59455-7801-4cd6-80c7-926ca83dba9a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.405971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e59455-7801-4cd6-80c7-926ca83dba9a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.406247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e59455-7801-4cd6-80c7-926ca83dba9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.406430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4249897-b0f9-4d67-8bd6-92e376de34d4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:33.413185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e59455-7801-4cd6-80c7-926ca83dba9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.414623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e59455-7801-4cd6-80c7-926ca83dba9a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-87e59455-7801-4cd6-80c7-926ca83dba9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:33.426298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:33.427139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:33.427978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:33.427978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:33.427978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:33.427978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:33.427978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:33.427978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:33.427978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:33.427978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:33.427978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 209/408] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:33.428508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e59455-7801-4cd6-80c7-926ca83dba9a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:33.464303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:33.520327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4249897-b0f9-4d67-8bd6-92e376de34d4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.535728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e59455-7801-4cd6-80c7-926ca83dba9a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.560725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df09a6-895d-48aa-b92b-45858829d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.561397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df09a6-895d-48aa-b92b-45858829d9d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.561687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df09a6-895d-48aa-b92b-45858829d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.561965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df09a6-895d-48aa-b92b-45858829d9d1 None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/35afc6fb66a649e2a9d22ee01cccbc53/roles/2840a8ea5485428fad61d84f364bcecb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.574175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297f620-a2c9-4eb3-85fe-110a9a66c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.575371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297f620-a2c9-4eb3-85fe-110a9a66c133 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.575778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297f620-a2c9-4eb3-85fe-110a9a66c133 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.576188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297f620-a2c9-4eb3-85fe-110a9a66c133 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.577054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297f620-a2c9-4eb3-85fe-110a9a66c133 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:33.577304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df09a6-895d-48aa-b92b-45858829d9d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=35afc6fb66a649e2a9d22ee01cccbc53, role_id=2840a8ea5485428fad61d84f364bcecb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.577662 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297f620-a2c9-4eb3-85fe-110a9a66c133 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.578767 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df09a6-895d-48aa-b92b-45858829d9d1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.579505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297f620-a2c9-4eb3-85fe-110a9a66c133 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.592018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 200/409] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:21:33 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/35afc6fb66a649e2a9d22ee01cccbc53/roles/2840a8ea5485428fad61d84f364bcecb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:33.592898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df09a6-895d-48aa-b92b-45858829d9d1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:33.595598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:33.604691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 210/410] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:33.605812 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297f620-a2c9-4eb3-85fe-110a9a66c133 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:33.733847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df09a6-895d-48aa-b92b-45858829d9d1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.741451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:33.754452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297f620-a2c9-4eb3-85fe-110a9a66c133 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.775881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9167cf-2ffc-4661-b193-2179b86c5946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.776799 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9167cf-2ffc-4661-b193-2179b86c5946 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.777076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9167cf-2ffc-4661-b193-2179b86c5946 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.777351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9167cf-2ffc-4661-b193-2179b86c5946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.788534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9167cf-2ffc-4661-b193-2179b86c5946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.790097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9167cf-2ffc-4661-b193-2179b86c5946 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.796920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9dc05-efb3-402f-95fe-f0a23192250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.797531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9dc05-efb3-402f-95fe-f0a23192250d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.797870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9dc05-efb3-402f-95fe-f0a23192250d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.798153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9dc05-efb3-402f-95fe-f0a23192250d None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.798850 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9dc05-efb3-402f-95fe-f0a23192250d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:33.799157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9dc05-efb3-402f-95fe-f0a23192250d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.801375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9dc05-efb3-402f-95fe-f0a23192250d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5f9167cf-2ffc-4661-b193-2179b86c5946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:33.807117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:33.807994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:33.808849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:33.808849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:33.808849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:33.810914 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 201/411] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:33.811834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9167cf-2ffc-4661-b193-2179b86c5946 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:33.820554 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 211/412] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:33.822066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9dc05-efb3-402f-95fe-f0a23192250d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:33.893542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:33.942475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9dc05-efb3-402f-95fe-f0a23192250d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.952103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9167cf-2ffc-4661-b193-2179b86c5946 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:33.987764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a232c-1d80-4fee-a0b6-721944d04f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.988371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a232c-1d80-4fee-a0b6-721944d04f2b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.988683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a232c-1d80-4fee-a0b6-721944d04f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.988957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a232c-1d80-4fee-a0b6-721944d04f2b None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:33.989851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a232c-1d80-4fee-a0b6-721944d04f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:33.990152 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a232c-1d80-4fee-a0b6-721944d04f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:33.991526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a232c-1d80-4fee-a0b6-721944d04f2b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:33.991913 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9fd4-11d8-4676-89f9-0e478d4526f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:33.992676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9fd4-11d8-4676-89f9-0e478d4526f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:33.993028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9fd4-11d8-4676-89f9-0e478d4526f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:33.993902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9fd4-11d8-4676-89f9-0e478d4526f1 None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/4b71b778b0b24cbb92446070934d68ac/roles/2840a8ea5485428fad61d84f364bcecb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:34.008563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 212/413] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:34.009991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a232c-1d80-4fee-a0b6-721944d04f2b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:34.018229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e9fd4-11d8-4676-89f9-0e478d4526f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=4b71b778b0b24cbb92446070934d68ac, role_id=2840a8ea5485428fad61d84f364bcecb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:34.020000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e9fd4-11d8-4676-89f9-0e478d4526f1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:34.027530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:34.036407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 202/414] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:21:33 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/4b71b778b0b24cbb92446070934d68ac/roles/2840a8ea5485428fad61d84f364bcecb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:34.037409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9fd4-11d8-4676-89f9-0e478d4526f1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:34.184898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a232c-1d80-4fee-a0b6-721944d04f2b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:34.203985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9fd4-11d8-4676-89f9-0e478d4526f1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:34.208142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:34.245678 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe7b7b-ee56-44d8-9850-facd42e1ddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:34.246636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe7b7b-ee56-44d8-9850-facd42e1ddde None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:34.247055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe7b7b-ee56-44d8-9850-facd42e1ddde None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:34.247462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe7b7b-ee56-44d8-9850-facd42e1ddde None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/de29056c157e47a49e55a75fb0792dc6/roles/2840a8ea5485428fad61d84f364bcecb` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:34.265364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe7b7b-ee56-44d8-9850-facd42e1ddde None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=de29056c157e47a49e55a75fb0792dc6, role_id=2840a8ea5485428fad61d84f364bcecb)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:34.267064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe7b7b-ee56-44d8-9850-facd42e1ddde None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:34.268905 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c227dc0-1253-448b-8087-20864c540fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:34.269674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c227dc0-1253-448b-8087-20864c540fac None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:34.269957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c227dc0-1253-448b-8087-20864c540fac None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:34.270230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c227dc0-1253-448b-8087-20864c540fac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:34.280155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c227dc0-1253-448b-8087-20864c540fac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:34.281828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c227dc0-1253-448b-8087-20864c540fac None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:34.289535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 213/415] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:21:34 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/de29056c157e47a49e55a75fb0792dc6/roles/2840a8ea5485428fad61d84f364bcecb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6c227dc0-1253-448b-8087-20864c540fac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:34.303715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:34.304840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:34.305931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:34.305931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:34.305931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:34.305931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:34.305931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:34.305931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:34.305931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:34.305931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:34.308078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 203/416] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:34.314309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe7b7b-ee56-44d8-9850-facd42e1ddde None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:34.391454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:34.437222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe7b7b-ee56-44d8-9850-facd42e1ddde None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:34.493615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec87dda-38cb-4f1c-a41d-e193f0eac075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:34.494599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec87dda-38cb-4f1c-a41d-e193f0eac075 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:34.495019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec87dda-38cb-4f1c-a41d-e193f0eac075 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:34.495459 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec87dda-38cb-4f1c-a41d-e193f0eac075 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:34.496312 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec87dda-38cb-4f1c-a41d-e193f0eac075 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:34.496777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec87dda-38cb-4f1c-a41d-e193f0eac075 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:34.498447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec87dda-38cb-4f1c-a41d-e193f0eac075 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:34.517748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 214/417] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:34.524012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c227dc0-1253-448b-8087-20864c540fac None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:34.656094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c227dc0-1253-448b-8087-20864c540fac None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:34.777744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781a211-701d-4a1f-a2bf-382ef3b10d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:34.778426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781a211-701d-4a1f-a2bf-382ef3b10d37 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:34.778708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781a211-701d-4a1f-a2bf-382ef3b10d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:34.778988 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781a211-701d-4a1f-a2bf-382ef3b10d37 None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/aea5fababc0a497686549ed7b9b85c78/roles/2840a8ea5485428fad61d84f364bcecb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:34.805101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781a211-701d-4a1f-a2bf-382ef3b10d37 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=aea5fababc0a497686549ed7b9b85c78, role_id=2840a8ea5485428fad61d84f364bcecb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:34.807070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781a211-701d-4a1f-a2bf-382ef3b10d37 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:34.830994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 204/418] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:21:34 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/aea5fababc0a497686549ed7b9b85c78/roles/2840a8ea5485428fad61d84f364bcecb => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:35.320477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf43ee-4e6a-4bf1-aa17-c857b12deae8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:35.321982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf43ee-4e6a-4bf1-aa17-c857b12deae8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:35.322486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf43ee-4e6a-4bf1-aa17-c857b12deae8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:35.324271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 215/419] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:35.329435 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a28cbc-88c3-4866-a552-9a73a0525ad2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:35.329719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a28cbc-88c3-4866-a552-9a73a0525ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:35.329989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a28cbc-88c3-4866-a552-9a73a0525ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:35.357513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-24a28cbc-88c3-4866-a552-9a73a0525ad2 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:35.358711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-24a28cbc-88c3-4866-a552-9a73a0525ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:35.369706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:35.443840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 205/420] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:35.784060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf43ee-4e6a-4bf1-aa17-c857b12deae8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:35.913131 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf43ee-4e6a-4bf1-aa17-c857b12deae8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:35.943163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:35.956919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f207b30-e5d4-407a-8a9b-8d9483ea2497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:35.957883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f207b30-e5d4-407a-8a9b-8d9483ea2497 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:35.958369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f207b30-e5d4-407a-8a9b-8d9483ea2497 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:35.958834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f207b30-e5d4-407a-8a9b-8d9483ea2497 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:35.976081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f207b30-e5d4-407a-8a9b-8d9483ea2497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7f207b30-e5d4-407a-8a9b-8d9483ea2497 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:35.981406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:35.982304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:35.983080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 216/421] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:35.990008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a28cbc-88c3-4866-a552-9a73a0525ad2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:36.140099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a28cbc-88c3-4866-a552-9a73a0525ad2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:36.188658 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95c98e-3e41-47d8-b5ec-9e5370adcc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:36.189246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95c98e-3e41-47d8-b5ec-9e5370adcc45 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:36.189521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95c98e-3e41-47d8-b5ec-9e5370adcc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:36.189792 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95c98e-3e41-47d8-b5ec-9e5370adcc45 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:36.190450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95c98e-3e41-47d8-b5ec-9e5370adcc45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:36.190749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95c98e-3e41-47d8-b5ec-9e5370adcc45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:36.192104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95c98e-3e41-47d8-b5ec-9e5370adcc45 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:36.203456 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 206/422] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:36.209083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f207b30-e5d4-407a-8a9b-8d9483ea2497 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:36.338268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f207b30-e5d4-407a-8a9b-8d9483ea2497 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:36.380057 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7e8fe-a3d6-4be1-b077-af2b423643a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:36.380724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7e8fe-a3d6-4be1-b077-af2b423643a0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:36.381004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7e8fe-a3d6-4be1-b077-af2b423643a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:36.381291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7e8fe-a3d6-4be1-b077-af2b423643a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:36.392326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7e8fe-a3d6-4be1-b077-af2b423643a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:36.393796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7e8fe-a3d6-4be1-b077-af2b423643a0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-92f7e8fe-a3d6-4be1-b077-af2b423643a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:36.416027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:36.417010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:36.417844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:36.417844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:36.417844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:36.421674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 217/423] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:36.427049 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95c98e-3e41-47d8-b5ec-9e5370adcc45 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:36.437035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:36.560373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95c98e-3e41-47d8-b5ec-9e5370adcc45 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:36.601747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ad2f7-9654-4453-a218-08dd20964cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:36.602808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ad2f7-9654-4453-a218-08dd20964cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:36.603101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ad2f7-9654-4453-a218-08dd20964cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:36.603372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ad2f7-9654-4453-a218-08dd20964cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:36.604032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ad2f7-9654-4453-a218-08dd20964cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:36.604334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ad2f7-9654-4453-a218-08dd20964cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:36.605789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ad2f7-9654-4453-a218-08dd20964cf3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:36.625050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2b580-970e-4829-b126-4a80aaba276b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:36.625377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2b580-970e-4829-b126-4a80aaba276b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:36.625579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2b580-970e-4829-b126-4a80aaba276b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:36.626901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 218/424] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:36.627706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 207/425] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:36.632935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2b580-970e-4829-b126-4a80aaba276b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:36.644263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175476c5-4d6e-46fc-b9e2-bb366bb0213c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:36.644622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175476c5-4d6e-46fc-b9e2-bb366bb0213c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:36.644832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175476c5-4d6e-46fc-b9e2-bb366bb0213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:36.682659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-175476c5-4d6e-46fc-b9e2-bb366bb0213c None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:36.684919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-175476c5-4d6e-46fc-b9e2-bb366bb0213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:36.700280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:36.770339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:36.780365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2b580-970e-4829-b126-4a80aaba276b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:36.780906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 208/426] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:36.782518 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ae946-8e7d-4ff9-bbec-241ae2e7ff67 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:36.783040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ae946-8e7d-4ff9-bbec-241ae2e7ff67 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:36.783500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ae946-8e7d-4ff9-bbec-241ae2e7ff67 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:36.785330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 209/427] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:36.791232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f45aa-5879-485a-860d-2a96995944d5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:36.791817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f45aa-5879-485a-860d-2a96995944d5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:36.792285 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f45aa-5879-485a-860d-2a96995944d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:36.811940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-882f45aa-5879-485a-860d-2a96995944d5 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:36.813548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-882f45aa-5879-485a-860d-2a96995944d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:36.817419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8da8d9-e163-4272-bb22-c14b0d5b2aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:36.817972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8da8d9-e163-4272-bb22-c14b0d5b2aae None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:36.818253 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8da8d9-e163-4272-bb22-c14b0d5b2aae None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:36.818568 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8da8d9-e163-4272-bb22-c14b0d5b2aae None admin] PATH_INFO: `/v3/users/swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:36.827469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8da8d9-e163-4272-bb22-c14b0d5b2aae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:36.828981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8da8d9-e163-4272-bb22-c14b0d5b2aae None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8a8da8d9-e163-4272-bb22-c14b0d5b2aae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:36.842592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:36.843511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:36.844384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 219/428] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:21:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:36.849535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8da8d9-e163-4272-bb22-c14b0d5b2aae None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:36.890607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 210/429] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:36.956099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:36.963129 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8da8d9-e163-4272-bb22-c14b0d5b2aae None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:36.998254 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67c627-b622-47eb-beea-6f7b4cf6a6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:36.998855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c627-b622-47eb-beea-6f7b4cf6a6ec None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:36.999135 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c627-b622-47eb-beea-6f7b4cf6a6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:36.999401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c627-b622-47eb-beea-6f7b4cf6a6ec None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.000121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67c627-b622-47eb-beea-6f7b4cf6a6ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:37.000425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67c627-b622-47eb-beea-6f7b4cf6a6ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:37.001873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67c627-b622-47eb-beea-6f7b4cf6a6ec None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:37.020278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 220/430] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Nov 2 03:21:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:37.026479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f45aa-5879-485a-860d-2a96995944d5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:37.178849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f45aa-5879-485a-860d-2a96995944d5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:37.214945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:37.218875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67c627-b622-47eb-beea-6f7b4cf6a6ec None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:37.233538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7c52-35f7-49b5-852c-2ae4ff97eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:37.234181 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7c52-35f7-49b5-852c-2ae4ff97eb9e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.234507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7c52-35f7-49b5-852c-2ae4ff97eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.234780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7c52-35f7-49b5-852c-2ae4ff97eb9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.250410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7c52-35f7-49b5-852c-2ae4ff97eb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:37.251957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7c52-35f7-49b5-852c-2ae4ff97eb9e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bcee7c52-35f7-49b5-852c-2ae4ff97eb9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:37.268118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:37.269043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:37.270347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:37.270347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:37.270347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:37.270347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 211/431] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:37.277799 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7c52-35f7-49b5-852c-2ae4ff97eb9e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:37.344084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67c627-b622-47eb-beea-6f7b4cf6a6ec None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:37.381257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26ff64-4f01-4433-8dae-eae844139bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:37.381887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ff64-4f01-4433-8dae-eae844139bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.382166 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ff64-4f01-4433-8dae-eae844139bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.382439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ff64-4f01-4433-8dae-eae844139bc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.392799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26ff64-4f01-4433-8dae-eae844139bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:37.393844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7c52-35f7-49b5-852c-2ae4ff97eb9e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-bc26ff64-4f01-4433-8dae-eae844139bc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:37.397617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:37.398506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 221/432] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:37.400663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e620-5fdc-4fb7-8605-ded060ed38dd None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.401376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e620-5fdc-4fb7-8605-ded060ed38dd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.401376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e620-5fdc-4fb7-8605-ded060ed38dd None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.405019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 222/433] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:37.405994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e620-5fdc-4fb7-8605-ded060ed38dd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:37.422837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:37.441212 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a317-7dde-440a-8d31-d0cbfe79fdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:37.441756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a317-7dde-440a-8d31-d0cbfe79fdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.442036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a317-7dde-440a-8d31-d0cbfe79fdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.442309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a317-7dde-440a-8d31-d0cbfe79fdf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.442983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621a317-7dde-440a-8d31-d0cbfe79fdf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:37.443252 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621a317-7dde-440a-8d31-d0cbfe79fdf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:37.444638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621a317-7dde-440a-8d31-d0cbfe79fdf1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:37.457286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 212/434] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:37.461862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a317-7dde-440a-8d31-d0cbfe79fdf1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:37.514503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:37.527770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e620-5fdc-4fb7-8605-ded060ed38dd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:37.565002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c967a19-14c8-420d-aad8-45f25441a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:37.565918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c967a19-14c8-420d-aad8-45f25441a454 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.566430 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c967a19-14c8-420d-aad8-45f25441a454 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.566881 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c967a19-14c8-420d-aad8-45f25441a454 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.576196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a317-7dde-440a-8d31-d0cbfe79fdf1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:37.578382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c967a19-14c8-420d-aad8-45f25441a454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4c967a19-14c8-420d-aad8-45f25441a454 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:37.583289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:37.584182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:37.585011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 223/435] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:37.586767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c2c8-f444-4f45-a61b-e7731647eb89 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.586767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c2c8-f444-4f45-a61b-e7731647eb89 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.586767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913c2c8-f444-4f45-a61b-e7731647eb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.604672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e913c2c8-f444-4f45-a61b-e7731647eb89 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:37.605854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e913c2c8-f444-4f45-a61b-e7731647eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:37.616337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabae805-fe44-4ea8-99ef-ce95254e63d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:37.616975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabae805-fe44-4ea8-99ef-ce95254e63d4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.617256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabae805-fe44-4ea8-99ef-ce95254e63d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.617540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabae805-fe44-4ea8-99ef-ce95254e63d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.618885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabae805-fe44-4ea8-99ef-ce95254e63d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:37.619275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabae805-fe44-4ea8-99ef-ce95254e63d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:37.620660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabae805-fe44-4ea8-99ef-ce95254e63d4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:37.628394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 213/436] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:37.633694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabae805-fe44-4ea8-99ef-ce95254e63d4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:37.676270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 224/437] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:37.677133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913c2c8-f444-4f45-a61b-e7731647eb89 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:37.679238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:37.744994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:37.748575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabae805-fe44-4ea8-99ef-ce95254e63d4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:37.790856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f261c23-f14a-49ec-8a0d-065f82359470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:37.791641 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f261c23-f14a-49ec-8a0d-065f82359470 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.792198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f261c23-f14a-49ec-8a0d-065f82359470 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.792513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f261c23-f14a-49ec-8a0d-065f82359470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.793890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913c2c8-f444-4f45-a61b-e7731647eb89 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:37.799863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f261c23-f14a-49ec-8a0d-065f82359470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:37.801520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f261c23-f14a-49ec-8a0d-065f82359470 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3f261c23-f14a-49ec-8a0d-065f82359470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:37.812959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:37.813778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:37.814608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:37.814608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:37.814608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:37.814608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:37.814608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:37.814608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:37.814608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:37.814608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:37.814608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 214/438] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:37.815479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab8a9d-1fb5-4de7-bea1-f950b0789785 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.815479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab8a9d-1fb5-4de7-bea1-f950b0789785 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.815706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab8a9d-1fb5-4de7-bea1-f950b0789785 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.817025 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 215/439] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:37.821629 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab8a9d-1fb5-4de7-bea1-f950b0789785 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:37.837154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9807-da13-4153-ba53-4047d8ba1b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:37.837923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9807-da13-4153-ba53-4047d8ba1b27 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.838200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9807-da13-4153-ba53-4047d8ba1b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.838477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9807-da13-4153-ba53-4047d8ba1b27 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.839132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c9807-da13-4153-ba53-4047d8ba1b27 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:37.839431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c9807-da13-4153-ba53-4047d8ba1b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:37.840872 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c9807-da13-4153-ba53-4047d8ba1b27 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:37.853703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 225/440] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:37.853703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9807-da13-4153-ba53-4047d8ba1b27 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:37.915742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:37.939655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab8a9d-1fb5-4de7-bea1-f950b0789785 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:37.955744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9807-da13-4153-ba53-4047d8ba1b27 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:37.973499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f9f8c-f543-458e-8194-7b79e232f818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:37.974120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9f8c-f543-458e-8194-7b79e232f818 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.974397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9f8c-f543-458e-8194-7b79e232f818 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.974665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9f8c-f543-458e-8194-7b79e232f818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.985622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f9f8c-f543-458e-8194-7b79e232f818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:37.987041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f9f8c-f543-458e-8194-7b79e232f818 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:37.990376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24299478-a27a-464c-826b-6096746c24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:37.990976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24299478-a27a-464c-826b-6096746c24fa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:37.991255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24299478-a27a-464c-826b-6096746c24fa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:37.991526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24299478-a27a-464c-826b-6096746c24fa None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:37.992209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24299478-a27a-464c-826b-6096746c24fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:37.992541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24299478-a27a-464c-826b-6096746c24fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:37.993964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24299478-a27a-464c-826b-6096746c24fa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-693f9f8c-f543-458e-8194-7b79e232f818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:38.000936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:38.001842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:38.002662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:38.002662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:38.002662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:38.002662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 216/441] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:38.003427 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b5d6-079f-4c43-a555-c8fceb4ebab9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.003709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b5d6-079f-4c43-a555-c8fceb4ebab9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.003983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b5d6-079f-4c43-a555-c8fceb4ebab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.010305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 226/442] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:38.011176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24299478-a27a-464c-826b-6096746c24fa None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.022093 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-04e8b5d6-079f-4c43-a555-c8fceb4ebab9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:38.023281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-04e8b5d6-079f-4c43-a555-c8fceb4ebab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:38.031138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:38.092843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 217/443] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:38.093776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8b5d6-079f-4c43-a555-c8fceb4ebab9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.130734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24299478-a27a-464c-826b-6096746c24fa None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.156415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:38.169277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1bba4-565e-4f2d-b918-e9f3158ecff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:38.169907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bba4-565e-4f2d-b918-e9f3158ecff8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.170455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bba4-565e-4f2d-b918-e9f3158ecff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.170572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bba4-565e-4f2d-b918-e9f3158ecff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.182361 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1bba4-565e-4f2d-b918-e9f3158ecff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:38.183933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1bba4-565e-4f2d-b918-e9f3158ecff8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:38.195344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8b5d6-079f-4c43-a555-c8fceb4ebab9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-9bf1bba4-565e-4f2d-b918-e9f3158ecff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:38.199547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:38.200411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:38.201308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:38.201308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:38.201308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:38.205442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 227/444] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:38.206119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1bba4-565e-4f2d-b918-e9f3158ecff8 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.232554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5de4b-f6b6-4bfe-99b6-bc3c5a04cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:38.233186 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5de4b-f6b6-4bfe-99b6-bc3c5a04cca5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.233465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5de4b-f6b6-4bfe-99b6-bc3c5a04cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.233739 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5de4b-f6b6-4bfe-99b6-bc3c5a04cca5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.245018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5de4b-f6b6-4bfe-99b6-bc3c5a04cca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0bd5de4b-f6b6-4bfe-99b6-bc3c5a04cca5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:38.249852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:38.250919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:38.252141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:38.255740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 218/445] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:38.256567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5de4b-f6b6-4bfe-99b6-bc3c5a04cca5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.260416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:38.310984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1bba4-565e-4f2d-b918-e9f3158ecff8 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.345044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7987-6841-4792-8f82-aae33097ee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:38.345654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7987-6841-4792-8f82-aae33097ee7c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.345940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7987-6841-4792-8f82-aae33097ee7c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.346193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7987-6841-4792-8f82-aae33097ee7c None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.346829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad7987-6841-4792-8f82-aae33097ee7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:38.347133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad7987-6841-4792-8f82-aae33097ee7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:38.348548 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad7987-6841-4792-8f82-aae33097ee7c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:38.361090 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 228/446] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:38.361885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7987-6841-4792-8f82-aae33097ee7c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.368696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5de4b-f6b6-4bfe-99b6-bc3c5a04cca5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.396476 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:38.406174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030980c-dc16-42d4-89f5-e847da9f28a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:38.406846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030980c-dc16-42d4-89f5-e847da9f28a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.407124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030980c-dc16-42d4-89f5-e847da9f28a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.407399 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030980c-dc16-42d4-89f5-e847da9f28a4 None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/89782ff12f5c49da80c7568ccab38c13/roles/2840a8ea5485428fad61d84f364bcecb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.422512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030980c-dc16-42d4-89f5-e847da9f28a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=89782ff12f5c49da80c7568ccab38c13, role_id=2840a8ea5485428fad61d84f364bcecb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:38.423945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030980c-dc16-42d4-89f5-e847da9f28a4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:38.436069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 219/447] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:21:38 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/89782ff12f5c49da80c7568ccab38c13/roles/2840a8ea5485428fad61d84f364bcecb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:38.436895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030980c-dc16-42d4-89f5-e847da9f28a4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.468344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7987-6841-4792-8f82-aae33097ee7c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.498801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:38.507909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcffdc-55fd-4793-8f58-ee14de90be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:38.508620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcffdc-55fd-4793-8f58-ee14de90be1e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.508905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcffdc-55fd-4793-8f58-ee14de90be1e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.509178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcffdc-55fd-4793-8f58-ee14de90be1e None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.509853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcffdc-55fd-4793-8f58-ee14de90be1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:38.510158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcffdc-55fd-4793-8f58-ee14de90be1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:38.511592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcffdc-55fd-4793-8f58-ee14de90be1e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:38.528939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 229/448] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:38.528939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcffdc-55fd-4793-8f58-ee14de90be1e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.558907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030980c-dc16-42d4-89f5-e847da9f28a4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.599613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c343-e001-43ec-a6f9-16740a957e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:38.600626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c343-e001-43ec-a6f9-16740a957e3c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.601048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c343-e001-43ec-a6f9-16740a957e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.601580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c343-e001-43ec-a6f9-16740a957e3c None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.602561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10c343-e001-43ec-a6f9-16740a957e3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:38.602677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10c343-e001-43ec-a6f9-16740a957e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:38.604022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10c343-e001-43ec-a6f9-16740a957e3c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:38.617423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 220/449] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:38.619154 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c343-e001-43ec-a6f9-16740a957e3c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.637902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:38.644041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcffdc-55fd-4793-8f58-ee14de90be1e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.679805 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41120bb-8b10-4eb0-87e9-5b487ec53586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:38.681238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41120bb-8b10-4eb0-87e9-5b487ec53586 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.681706 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41120bb-8b10-4eb0-87e9-5b487ec53586 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.682140 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41120bb-8b10-4eb0-87e9-5b487ec53586 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.692375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41120bb-8b10-4eb0-87e9-5b487ec53586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e41120bb-8b10-4eb0-87e9-5b487ec53586 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:38.698098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:38.699150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:38.700024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:38.701795 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 230/450] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:38.702697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41120bb-8b10-4eb0-87e9-5b487ec53586 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.728350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c343-e001-43ec-a6f9-16740a957e3c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.742740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:38.766015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e0ab4-1fa6-4731-8197-98752d90167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:38.766922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e0ab4-1fa6-4731-8197-98752d90167d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.767340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e0ab4-1fa6-4731-8197-98752d90167d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.767766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e0ab4-1fa6-4731-8197-98752d90167d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.776210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e0ab4-1fa6-4731-8197-98752d90167d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:38.777966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e0ab4-1fa6-4731-8197-98752d90167d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b55e0ab4-1fa6-4731-8197-98752d90167d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:38.790487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:38.791550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:38.792662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:38.792662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:38.792662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:38.792662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:38.792662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:38.792662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:38.792662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:38.792662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:38.792662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:21:38.792662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:38.799125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 221/451] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:38.800235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e0ab4-1fa6-4731-8197-98752d90167d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.807277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41120bb-8b10-4eb0-87e9-5b487ec53586 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.841705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35743d9b-5069-4f76-8646-d956bf9d3f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:38.842331 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35743d9b-5069-4f76-8646-d956bf9d3f32 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.842613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35743d9b-5069-4f76-8646-d956bf9d3f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.842889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35743d9b-5069-4f76-8646-d956bf9d3f32 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.850328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35743d9b-5069-4f76-8646-d956bf9d3f32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:38.851774 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35743d9b-5069-4f76-8646-d956bf9d3f32 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-35743d9b-5069-4f76-8646-d956bf9d3f32 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:38.865065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:38.866157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:38.867066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 231/452] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:38.867638 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35743d9b-5069-4f76-8646-d956bf9d3f32 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:38.890942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:38.916109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e0ab4-1fa6-4731-8197-98752d90167d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.952758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951507f-e426-4741-ac11-813c22040221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:38.953387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951507f-e426-4741-ac11-813c22040221 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:38.953654 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951507f-e426-4741-ac11-813c22040221 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:38.953922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951507f-e426-4741-ac11-813c22040221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:38.965817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951507f-e426-4741-ac11-813c22040221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:38.967272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951507f-e426-4741-ac11-813c22040221 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:38.975374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35743d9b-5069-4f76-8646-d956bf9d3f32 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6951507f-e426-4741-ac11-813c22040221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:38.982174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:38.983082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:38.984013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:38.984013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:38.984013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:38.984013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 222/453] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:38.984638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951507f-e426-4741-ac11-813c22040221 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:39.016485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3e4d9-e79c-44b4-9de1-171095d72b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:39.017031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3e4d9-e79c-44b4-9de1-171095d72b31 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:39.017314 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3e4d9-e79c-44b4-9de1-171095d72b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:39.017587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3e4d9-e79c-44b4-9de1-171095d72b31 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:39.018271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3e4d9-e79c-44b4-9de1-171095d72b31 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:39.018578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3e4d9-e79c-44b4-9de1-171095d72b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:39.019682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:39.020015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3e4d9-e79c-44b4-9de1-171095d72b31 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:39.028159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 232/454] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:39.029249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3e4d9-e79c-44b4-9de1-171095d72b31 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:39.110353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951507f-e426-4741-ac11-813c22040221 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:39.110879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:39.135467 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3e4d9-e79c-44b4-9de1-171095d72b31 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:39.145335 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51676ea0-a89c-496b-8e8d-2763b0afa67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:39.145956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676ea0-a89c-496b-8e8d-2763b0afa67b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:39.146225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676ea0-a89c-496b-8e8d-2763b0afa67b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:39.146497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676ea0-a89c-496b-8e8d-2763b0afa67b None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:39.147216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51676ea0-a89c-496b-8e8d-2763b0afa67b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:39.147638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51676ea0-a89c-496b-8e8d-2763b0afa67b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:39.148992 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51676ea0-a89c-496b-8e8d-2763b0afa67b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:39.171500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 223/455] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Nov 2 03:21:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:39.172234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51676ea0-a89c-496b-8e8d-2763b0afa67b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:39.178219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b006f-1fae-4eef-8214-bf52ff35972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:39.178838 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b006f-1fae-4eef-8214-bf52ff35972e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:39.179117 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b006f-1fae-4eef-8214-bf52ff35972e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:39.179384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b006f-1fae-4eef-8214-bf52ff35972e None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:39.180142 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b006f-1fae-4eef-8214-bf52ff35972e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:39.181007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b006f-1fae-4eef-8214-bf52ff35972e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:39.182525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b006f-1fae-4eef-8214-bf52ff35972e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:39.200527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 233/456] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Nov 2 03:21:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:39.201177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b006f-1fae-4eef-8214-bf52ff35972e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:39.261252 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:39.280305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51676ea0-a89c-496b-8e8d-2763b0afa67b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:39.308801 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b006f-1fae-4eef-8214-bf52ff35972e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:39.320166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a264c4-3d12-4ab8-97f4-2fa52b328e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:39.321806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a264c4-3d12-4ab8-97f4-2fa52b328e79 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:39.322234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a264c4-3d12-4ab8-97f4-2fa52b328e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:39.322514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a264c4-3d12-4ab8-97f4-2fa52b328e79 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:39.323176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a264c4-3d12-4ab8-97f4-2fa52b328e79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:39.323497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a264c4-3d12-4ab8-97f4-2fa52b328e79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:39.324964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a264c4-3d12-4ab8-97f4-2fa52b328e79 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:39.337398 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 224/457] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:39.338291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a264c4-3d12-4ab8-97f4-2fa52b328e79 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:39.353220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214cf9-47f0-45b0-b8c6-6ae78e7b5f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:39.353860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214cf9-47f0-45b0-b8c6-6ae78e7b5f4b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:39.354201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214cf9-47f0-45b0-b8c6-6ae78e7b5f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:39.354389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214cf9-47f0-45b0-b8c6-6ae78e7b5f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:39.358021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:39.367367 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e214cf9-47f0-45b0-b8c6-6ae78e7b5f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:39.369641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e214cf9-47f0-45b0-b8c6-6ae78e7b5f4b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3e214cf9-47f0-45b0-b8c6-6ae78e7b5f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:39.385123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:39.386035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:39.386880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:39.386880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:39.386880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:39.390860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 234/458] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:39.391684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214cf9-47f0-45b0-b8c6-6ae78e7b5f4b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:39.444953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a264c4-3d12-4ab8-97f4-2fa52b328e79 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:39.479753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9b28-a60e-4237-ba98-99f5bc21b2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:39.480507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9b28-a60e-4237-ba98-99f5bc21b2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:39.480894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9b28-a60e-4237-ba98-99f5bc21b2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:39.481268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9b28-a60e-4237-ba98-99f5bc21b2e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:39.494574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214cf9-47f0-45b0-b8c6-6ae78e7b5f4b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:39.496505 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:39.531321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4318ef-9003-4c2d-ac47-bf290f9ab98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:39.531847 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4318ef-9003-4c2d-ac47-bf290f9ab98d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:39.532125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4318ef-9003-4c2d-ac47-bf290f9ab98d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:39.532398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4318ef-9003-4c2d-ac47-bf290f9ab98d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:39.553585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd9b28-a60e-4237-ba98-99f5bc21b2e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:39.555656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd9b28-a60e-4237-ba98-99f5bc21b2e5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:39.589717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:39.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4318ef-9003-4c2d-ac47-bf290f9ab98d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:39.606842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4318ef-9003-4c2d-ac47-bf290f9ab98d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:39.663134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 225/459] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:39.663316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9b28-a60e-4237-ba98-99f5bc21b2e5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:39.713703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:39.718925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 235/460] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:39.719908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4318ef-9003-4c2d-ac47-bf290f9ab98d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:39.773033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9b28-a60e-4237-ba98-99f5bc21b2e5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:39.808815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:39.809881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14181d01-ed46-49ea-83e2-5aa6277893a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:39.810594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14181d01-ed46-49ea-83e2-5aa6277893a2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:39.811028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14181d01-ed46-49ea-83e2-5aa6277893a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:39.811350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14181d01-ed46-49ea-83e2-5aa6277893a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:39.819737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14181d01-ed46-49ea-83e2-5aa6277893a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:39.821744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14181d01-ed46-49ea-83e2-5aa6277893a2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:39.822425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4318ef-9003-4c2d-ac47-bf290f9ab98d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-14181d01-ed46-49ea-83e2-5aa6277893a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:39.833882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:39.834922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 226/461] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:39.841238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14181d01-ed46-49ea-83e2-5aa6277893a2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:39.864095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864fcdc-3fa3-4af5-bb7f-4500deda081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:39.865050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864fcdc-3fa3-4af5-bb7f-4500deda081f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:39.865428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864fcdc-3fa3-4af5-bb7f-4500deda081f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:39.865770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864fcdc-3fa3-4af5-bb7f-4500deda081f None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:39.866480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864fcdc-3fa3-4af5-bb7f-4500deda081f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:39.866788 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864fcdc-3fa3-4af5-bb7f-4500deda081f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:39.868928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864fcdc-3fa3-4af5-bb7f-4500deda081f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:39.884770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 236/462] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:39.884770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864fcdc-3fa3-4af5-bb7f-4500deda081f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:39.951810 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14181d01-ed46-49ea-83e2-5aa6277893a2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:39.954225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:39.984847 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864fcdc-3fa3-4af5-bb7f-4500deda081f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:39.987472 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563c0d6-b11a-4ca7-b9ea-471e0233be42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:39.988200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c0d6-b11a-4ca7-b9ea-471e0233be42 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:39.988582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c0d6-b11a-4ca7-b9ea-471e0233be42 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:39.988925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c0d6-b11a-4ca7-b9ea-471e0233be42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.001052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563c0d6-b11a-4ca7-b9ea-471e0233be42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.002610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563c0d6-b11a-4ca7-b9ea-471e0233be42 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8563c0d6-b11a-4ca7-b9ea-471e0233be42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:40.017604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:40.018709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:40.019787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:40.019787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:40.019787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:40.025342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 227/463] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:40.025342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563c0d6-b11a-4ca7-b9ea-471e0233be42 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:40.026115 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae22f58-d042-49e6-a00d-081f74c86250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:40.026873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae22f58-d042-49e6-a00d-081f74c86250 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.027224 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae22f58-d042-49e6-a00d-081f74c86250 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.027565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae22f58-d042-49e6-a00d-081f74c86250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.038507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae22f58-d042-49e6-a00d-081f74c86250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.042562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae22f58-d042-49e6-a00d-081f74c86250 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.054554 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2ae22f58-d042-49e6-a00d-081f74c86250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:40.062561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:40.063594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:40.064609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:40.064609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:40.064609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:40.071374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 237/464] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:40.072143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae22f58-d042-49e6-a00d-081f74c86250 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:40.147690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563c0d6-b11a-4ca7-b9ea-471e0233be42 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:40.181276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae22f58-d042-49e6-a00d-081f74c86250 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:40.186519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b9d82-0fc1-486f-a40f-e381274aa0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:40.187130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b9d82-0fc1-486f-a40f-e381274aa0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.187406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b9d82-0fc1-486f-a40f-e381274aa0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.187676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b9d82-0fc1-486f-a40f-e381274aa0e4 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.188396 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b9d82-0fc1-486f-a40f-e381274aa0e4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:40.188724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b9d82-0fc1-486f-a40f-e381274aa0e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.190573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b9d82-0fc1-486f-a40f-e381274aa0e4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.213954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 228/465] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Nov 2 03:21:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:40.213954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b9d82-0fc1-486f-a40f-e381274aa0e4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:40.221490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd40d59-03e1-4b9c-856b-c2c9d5c16e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:40.222196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40d59-03e1-4b9c-856b-c2c9d5c16e61 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.222830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40d59-03e1-4b9c-856b-c2c9d5c16e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.222830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40d59-03e1-4b9c-856b-c2c9d5c16e61 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.228496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:40.231309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd40d59-03e1-4b9c-856b-c2c9d5c16e61 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.232864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd40d59-03e1-4b9c-856b-c2c9d5c16e61 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-bbd40d59-03e1-4b9c-856b-c2c9d5c16e61 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:40.245233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:40.246297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:40.247364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:40.247364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:40.247364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:40.247364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:40.247364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:40.247364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:40.247364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:40.247364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:40.247364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 03:21:40.247364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:40.253012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 238/466] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:40.253012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd40d59-03e1-4b9c-856b-c2c9d5c16e61 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:40.314571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:40.325140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b9d82-0fc1-486f-a40f-e381274aa0e4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:40.359062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd40d59-03e1-4b9c-856b-c2c9d5c16e61 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:40.361662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f17414-1512-4cec-9a53-8dc2900b5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:40.362274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17414-1512-4cec-9a53-8dc2900b5ece None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.362552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17414-1512-4cec-9a53-8dc2900b5ece None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.362822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17414-1512-4cec-9a53-8dc2900b5ece None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.363453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f17414-1512-4cec-9a53-8dc2900b5ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:40.363753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f17414-1512-4cec-9a53-8dc2900b5ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.365389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f17414-1512-4cec-9a53-8dc2900b5ece None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.377960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 229/467] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:40.379069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f17414-1512-4cec-9a53-8dc2900b5ece None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:40.396584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc397aa6-2dca-4aa4-9ce4-6daa8b34c326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:40.397190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc397aa6-2dca-4aa4-9ce4-6daa8b34c326 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.397470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc397aa6-2dca-4aa4-9ce4-6daa8b34c326 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.397749 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc397aa6-2dca-4aa4-9ce4-6daa8b34c326 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.398384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc397aa6-2dca-4aa4-9ce4-6daa8b34c326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:40.398683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc397aa6-2dca-4aa4-9ce4-6daa8b34c326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.400875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc397aa6-2dca-4aa4-9ce4-6daa8b34c326 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.413292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 239/468] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:40.414107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc397aa6-2dca-4aa4-9ce4-6daa8b34c326 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:40.467547 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:40.494436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f17414-1512-4cec-9a53-8dc2900b5ece None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:40.521981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc397aa6-2dca-4aa4-9ce4-6daa8b34c326 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:40.534279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151e411-18ae-4fa8-a174-3ea4987b8ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:40.534906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151e411-18ae-4fa8-a174-3ea4987b8ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.535184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151e411-18ae-4fa8-a174-3ea4987b8ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.535451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151e411-18ae-4fa8-a174-3ea4987b8ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.545199 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:40.561309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509bfb-d2bb-4879-9be7-9738360c662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:40.562022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509bfb-d2bb-4879-9be7-9738360c662d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.562299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509bfb-d2bb-4879-9be7-9738360c662d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.562569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509bfb-d2bb-4879-9be7-9738360c662d None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.563284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509bfb-d2bb-4879-9be7-9738360c662d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:40.563583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509bfb-d2bb-4879-9be7-9738360c662d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.565326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509bfb-d2bb-4879-9be7-9738360c662d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.584101 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 240/469] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Nov 2 03:21:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:40.584947 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509bfb-d2bb-4879-9be7-9738360c662d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:40.610468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151e411-18ae-4fa8-a174-3ea4987b8ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.612137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151e411-18ae-4fa8-a174-3ea4987b8ff1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.685428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:40.687284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509bfb-d2bb-4879-9be7-9738360c662d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:40.712943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 230/470] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:40.713787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151e411-18ae-4fa8-a174-3ea4987b8ff1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:40.726948 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeb763-98c1-4f56-b1d1-abc118ba93cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:40.728251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb763-98c1-4f56-b1d1-abc118ba93cd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.728676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb763-98c1-4f56-b1d1-abc118ba93cd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.728951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb763-98c1-4f56-b1d1-abc118ba93cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.735524 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afeb763-98c1-4f56-b1d1-abc118ba93cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.737019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afeb763-98c1-4f56-b1d1-abc118ba93cd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6afeb763-98c1-4f56-b1d1-abc118ba93cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:40.748611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:40.749443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:40.750275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:40.750275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:40.750275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:40.750275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:40.750275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:40.750275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:40.750275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:40.750275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:40.750275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 241/471] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:40.750740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeb763-98c1-4f56-b1d1-abc118ba93cd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:40.794197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:40.812948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151e411-18ae-4fa8-a174-3ea4987b8ff1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:40.846109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8814254-973b-414e-a191-f6aa98b45f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:40.846660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8814254-973b-414e-a191-f6aa98b45f75 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.846938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8814254-973b-414e-a191-f6aa98b45f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.847200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8814254-973b-414e-a191-f6aa98b45f75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.853654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeb763-98c1-4f56-b1d1-abc118ba93cd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:40.853943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8814254-973b-414e-a191-f6aa98b45f75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.855382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8814254-973b-414e-a191-f6aa98b45f75 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d8814254-973b-414e-a191-f6aa98b45f75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:40.866482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:40.867293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:40.868976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:40.868976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:40.868976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:40.868976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:40.868976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:40.868976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:40.868976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:40.868976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:40.868976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 231/472] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:40.869939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca199-5338-4875-afcc-61f6b464de84 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.869939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca199-5338-4875-afcc-61f6b464de84 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.869939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca199-5338-4875-afcc-61f6b464de84 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.875445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 232/473] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:40.875445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca199-5338-4875-afcc-61f6b464de84 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:40.889642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6212b77-26e2-4ff5-a688-90f4678dcf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:40.890245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212b77-26e2-4ff5-a688-90f4678dcf55 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:40.890529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212b77-26e2-4ff5-a688-90f4678dcf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:40.890804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212b77-26e2-4ff5-a688-90f4678dcf55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:40.907707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:40.957527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6212b77-26e2-4ff5-a688-90f4678dcf55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:40.958980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6212b77-26e2-4ff5-a688-90f4678dcf55 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:40.972441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca199-5338-4875-afcc-61f6b464de84 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:40.996089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:41.007832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211368c-fb55-4129-a918-7db53474e644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:41.009404 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211368c-fb55-4129-a918-7db53474e644 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.009640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211368c-fb55-4129-a918-7db53474e644 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.009916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211368c-fb55-4129-a918-7db53474e644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.020181 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211368c-fb55-4129-a918-7db53474e644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:41.021642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211368c-fb55-4129-a918-7db53474e644 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a211368c-fb55-4129-a918-7db53474e644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:41.036241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:41.037416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:41.038706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:41.038706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:41.038706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:41.038706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 233/474] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:41.038706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211368c-fb55-4129-a918-7db53474e644 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.060871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 242/475] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:41.061723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6212b77-26e2-4ff5-a688-90f4678dcf55 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.125509 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:41.140591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211368c-fb55-4129-a918-7db53474e644 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:41.160526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6212b77-26e2-4ff5-a688-90f4678dcf55 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:41.173793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e887a-964d-4c8b-b174-2df91618c963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:41.174394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e887a-964d-4c8b-b174-2df91618c963 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.174676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e887a-964d-4c8b-b174-2df91618c963 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.174945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e887a-964d-4c8b-b174-2df91618c963 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.175622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e887a-964d-4c8b-b174-2df91618c963 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:41.175924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e887a-964d-4c8b-b174-2df91618c963 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:41.177375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e887a-964d-4c8b-b174-2df91618c963 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:41.189070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 234/476] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:41.190501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d81c-ab75-4812-9101-aa1af9a6c35d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.190795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d81c-ab75-4812-9101-aa1af9a6c35d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.191068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d81c-ab75-4812-9101-aa1af9a6c35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.194518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e2b30-a408-49d4-a9f0-2a0f7dddecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:41.195125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2b30-a408-49d4-a9f0-2a0f7dddecaa None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.195405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2b30-a408-49d4-a9f0-2a0f7dddecaa None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.195680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2b30-a408-49d4-a9f0-2a0f7dddecaa None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.197236 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2b30-a408-49d4-a9f0-2a0f7dddecaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:41.197748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2b30-a408-49d4-a9f0-2a0f7dddecaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:41.199228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2b30-a408-49d4-a9f0-2a0f7dddecaa None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:41.206526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:41.209419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1571d81c-ab75-4812-9101-aa1af9a6c35d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:41.210640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1571d81c-ab75-4812-9101-aa1af9a6c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:41.212515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 243/477] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:41.213333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e2b30-a408-49d4-a9f0-2a0f7dddecaa None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.283222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 235/478] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:41.284307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571d81c-ab75-4812-9101-aa1af9a6c35d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.318082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e2b30-a408-49d4-a9f0-2a0f7dddecaa None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:41.353467 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdc0c0-bfe6-4439-a1b6-52f32bea34d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:41.354083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdc0c0-bfe6-4439-a1b6-52f32bea34d7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.354369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdc0c0-bfe6-4439-a1b6-52f32bea34d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.354647 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdc0c0-bfe6-4439-a1b6-52f32bea34d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.355452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdc0c0-bfe6-4439-a1b6-52f32bea34d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:41.356248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdc0c0-bfe6-4439-a1b6-52f32bea34d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:41.357732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdc0c0-bfe6-4439-a1b6-52f32bea34d7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:41.366835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:41.371274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 244/479] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:41.372856 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdc0c0-bfe6-4439-a1b6-52f32bea34d7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.395440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571d81c-ab75-4812-9101-aa1af9a6c35d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:41.432070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:41.433907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350181a2-9747-40ab-9b86-b37da24384de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:41.434430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350181a2-9747-40ab-9b86-b37da24384de None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.434770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350181a2-9747-40ab-9b86-b37da24384de None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.435041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350181a2-9747-40ab-9b86-b37da24384de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.446204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350181a2-9747-40ab-9b86-b37da24384de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:41.447663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350181a2-9747-40ab-9b86-b37da24384de None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-350181a2-9747-40ab-9b86-b37da24384de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:41.463688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:41.469931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:41.470998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:41.470998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:41.470998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:41.470998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 236/480] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:41.470998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350181a2-9747-40ab-9b86-b37da24384de None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.485591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdc0c0-bfe6-4439-a1b6-52f32bea34d7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:41.522168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2440e4-c0f5-404c-a448-d0955e1ee6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:41.522767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2440e4-c0f5-404c-a448-d0955e1ee6dc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.523155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2440e4-c0f5-404c-a448-d0955e1ee6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.523434 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2440e4-c0f5-404c-a448-d0955e1ee6dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.524926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2440e4-c0f5-404c-a448-d0955e1ee6dc None admin] RBAC: Adding query filter params (role.id=2840a8ea5485428fad61d84f364bcecb, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=35afc6fb66a649e2a9d22ee01cccbc53) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:41.525892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2440e4-c0f5-404c-a448-d0955e1ee6dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:41.526682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2440e4-c0f5-404c-a448-d0955e1ee6dc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:41.533425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 245/481] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/role_assignments?user.id=35afc6fb66a649e2a9d22ee01cccbc53&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=2840a8ea5485428fad61d84f364bcecb => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:41.534034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2440e4-c0f5-404c-a448-d0955e1ee6dc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.588398 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350181a2-9747-40ab-9b86-b37da24384de None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:41.620873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:41.632129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b56d7a-b7c7-4b4e-852a-1a0210a1417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:41.632944 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b56d7a-b7c7-4b4e-852a-1a0210a1417c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.633229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b56d7a-b7c7-4b4e-852a-1a0210a1417c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.633881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b56d7a-b7c7-4b4e-852a-1a0210a1417c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.634633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b56d7a-b7c7-4b4e-852a-1a0210a1417c None admin] RBAC: Adding query filter params (role.id=2840a8ea5485428fad61d84f364bcecb, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=4b71b778b0b24cbb92446070934d68ac) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:41.634940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b56d7a-b7c7-4b4e-852a-1a0210a1417c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:41.636408 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b56d7a-b7c7-4b4e-852a-1a0210a1417c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:41.652622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 237/482] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/role_assignments?user.id=4b71b778b0b24cbb92446070934d68ac&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=2840a8ea5485428fad61d84f364bcecb => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:41.652622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b56d7a-b7c7-4b4e-852a-1a0210a1417c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.659169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2440e4-c0f5-404c-a448-d0955e1ee6dc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:41.691455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:41.709445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b477-8ddd-4e33-bb52-e842c9734d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:41.710082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b477-8ddd-4e33-bb52-e842c9734d49 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.710527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b477-8ddd-4e33-bb52-e842c9734d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.710804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b477-8ddd-4e33-bb52-e842c9734d49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.720770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206b477-8ddd-4e33-bb52-e842c9734d49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:41.722281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206b477-8ddd-4e33-bb52-e842c9734d49 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b206b477-8ddd-4e33-bb52-e842c9734d49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:41.738461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:41.739725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:41.740703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:41.740703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:41.740703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:41.740703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:41.740703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:41.740703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:41.740703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:41.740703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:41.741521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 246/483] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:41.744493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b477-8ddd-4e33-bb52-e842c9734d49 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.787150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b56d7a-b7c7-4b4e-852a-1a0210a1417c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:41.823970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6114e0-8b6d-491e-8ac6-2c3caeafb59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:41.824494 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6114e0-8b6d-491e-8ac6-2c3caeafb59e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.825129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6114e0-8b6d-491e-8ac6-2c3caeafb59e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.825129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6114e0-8b6d-491e-8ac6-2c3caeafb59e None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.825687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6114e0-8b6d-491e-8ac6-2c3caeafb59e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:41.825997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6114e0-8b6d-491e-8ac6-2c3caeafb59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:41.827390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6114e0-8b6d-491e-8ac6-2c3caeafb59e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:41.841424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 238/484] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:41.842314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6114e0-8b6d-491e-8ac6-2c3caeafb59e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.886752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b477-8ddd-4e33-bb52-e842c9734d49 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:41.909966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:41.936191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93205-ee69-4ede-bbf3-359d49cbc5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:41.936985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93205-ee69-4ede-bbf3-359d49cbc5bf None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:41.937337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93205-ee69-4ede-bbf3-359d49cbc5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:41.937685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93205-ee69-4ede-bbf3-359d49cbc5bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:41.953118 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f93205-ee69-4ede-bbf3-359d49cbc5bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b7f93205-ee69-4ede-bbf3-359d49cbc5bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:41.959162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:41.960067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:41.960958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 247/485] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:41.961680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93205-ee69-4ede-bbf3-359d49cbc5bf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:41.975675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6114e0-8b6d-491e-8ac6-2c3caeafb59e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:42.013368 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e642a-0c22-4730-9fc8-52c114511c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:42.013979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e642a-0c22-4730-9fc8-52c114511c48 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:42.014255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e642a-0c22-4730-9fc8-52c114511c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:42.014523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e642a-0c22-4730-9fc8-52c114511c48 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:42.015218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e642a-0c22-4730-9fc8-52c114511c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:42.015522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e642a-0c22-4730-9fc8-52c114511c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:42.017000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e642a-0c22-4730-9fc8-52c114511c48 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:42.028822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:42.029774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 239/486] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:42.030609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e642a-0c22-4730-9fc8-52c114511c48 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:42.090733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93205-ee69-4ede-bbf3-359d49cbc5bf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:42.140860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e642a-0c22-4730-9fc8-52c114511c48 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:42.141051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881f483-4897-438f-99e6-2e66a9ad8e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:42.141700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881f483-4897-438f-99e6-2e66a9ad8e3b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:42.141982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881f483-4897-438f-99e6-2e66a9ad8e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:42.142522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881f483-4897-438f-99e6-2e66a9ad8e3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:42.153600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881f483-4897-438f-99e6-2e66a9ad8e3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:42.155034 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:42.156755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881f483-4897-438f-99e6-2e66a9ad8e3b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8881f483-4897-438f-99e6-2e66a9ad8e3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:42.175813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:42.176870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:42.177898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:42.177898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:42.177898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:42.177898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:42.177898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:42.177898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:42.177898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:42.177898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:42.178559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fc247-bf08-45e2-bc3a-9c89dc6a7617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:42.179226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fc247-bf08-45e2-bc3a-9c89dc6a7617 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:42.179507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fc247-bf08-45e2-bc3a-9c89dc6a7617 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:42.179779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fc247-bf08-45e2-bc3a-9c89dc6a7617 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:42.181298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fc247-bf08-45e2-bc3a-9c89dc6a7617 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:42.181298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fc247-bf08-45e2-bc3a-9c89dc6a7617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:42.182095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 248/487] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:42.182660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fc247-bf08-45e2-bc3a-9c89dc6a7617 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:42.183341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881f483-4897-438f-99e6-2e66a9ad8e3b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:42.202458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 240/488] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:42.202458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fc247-bf08-45e2-bc3a-9c89dc6a7617 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:42.304719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881f483-4897-438f-99e6-2e66a9ad8e3b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:42.306798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:42.345181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154ca78-a910-43ec-acc7-0267f4008ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:42.346053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154ca78-a910-43ec-acc7-0267f4008ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:42.346336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154ca78-a910-43ec-acc7-0267f4008ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:42.346607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154ca78-a910-43ec-acc7-0267f4008ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:42.347339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154ca78-a910-43ec-acc7-0267f4008ee2 None admin] RBAC: Adding query filter params (role.id=2840a8ea5485428fad61d84f364bcecb, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=de29056c157e47a49e55a75fb0792dc6) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:42.347646 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154ca78-a910-43ec-acc7-0267f4008ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:42.347881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fc247-bf08-45e2-bc3a-9c89dc6a7617 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:42.349112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154ca78-a910-43ec-acc7-0267f4008ee2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:42.357445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 249/489] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:21:42 2022] GET /identity/v3/role_assignments?user.id=de29056c157e47a49e55a75fb0792dc6&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=2840a8ea5485428fad61d84f364bcecb => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:42.358275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154ca78-a910-43ec-acc7-0267f4008ee2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:42.389015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7a3d-267e-448f-891a-a43897ae7209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:42.389780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7a3d-267e-448f-891a-a43897ae7209 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:42.390125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7a3d-267e-448f-891a-a43897ae7209 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:42.390487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7a3d-267e-448f-891a-a43897ae7209 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:42.391322 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7a3d-267e-448f-891a-a43897ae7209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:42.391695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7a3d-267e-448f-891a-a43897ae7209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:42.393215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7a3d-267e-448f-891a-a43897ae7209 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:42.409098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 241/490] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:42.421573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7a3d-267e-448f-891a-a43897ae7209 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:42.499756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:42.551180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154ca78-a910-43ec-acc7-0267f4008ee2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:42.613040 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160768d-e61c-401d-b0e4-9e789c55f5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:42.614453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160768d-e61c-401d-b0e4-9e789c55f5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:42.614866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160768d-e61c-401d-b0e4-9e789c55f5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:42.615280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160768d-e61c-401d-b0e4-9e789c55f5d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:42.626129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7a3d-267e-448f-891a-a43897ae7209 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:42.627899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160768d-e61c-401d-b0e4-9e789c55f5d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:42.629392 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160768d-e61c-401d-b0e4-9e789c55f5d4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-2160768d-e61c-401d-b0e4-9e789c55f5d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:42.645503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:42.648074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:42.651401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:42.651401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:42.651401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:42.651401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 250/491] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:42.659256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160768d-e61c-401d-b0e4-9e789c55f5d4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:42.667829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cd1d0-0fc8-42e2-a754-c646f2cc3a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:42.668780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd1d0-0fc8-42e2-a754-c646f2cc3a38 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:42.669067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd1d0-0fc8-42e2-a754-c646f2cc3a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:42.669340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd1d0-0fc8-42e2-a754-c646f2cc3a38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:42.670066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cd1d0-0fc8-42e2-a754-c646f2cc3a38 None admin] RBAC: Adding query filter params (role.id=2840a8ea5485428fad61d84f364bcecb, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=aea5fababc0a497686549ed7b9b85c78) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:42.670373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cd1d0-0fc8-42e2-a754-c646f2cc3a38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:42.672094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cd1d0-0fc8-42e2-a754-c646f2cc3a38 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:42.682098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 242/492] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:21:42 2022] GET /identity/v3/role_assignments?user.id=aea5fababc0a497686549ed7b9b85c78&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=2840a8ea5485428fad61d84f364bcecb => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:42.694397 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:42.829180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160768d-e61c-401d-b0e4-9e789c55f5d4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:42.895249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c594882-674d-47b4-b55d-158852ee4be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:42.895879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594882-674d-47b4-b55d-158852ee4be6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:42.896160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594882-674d-47b4-b55d-158852ee4be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:42.896429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594882-674d-47b4-b55d-158852ee4be6 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:42.897110 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c594882-674d-47b4-b55d-158852ee4be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:42.897412 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c594882-674d-47b4-b55d-158852ee4be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:42.899346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c594882-674d-47b4-b55d-158852ee4be6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:42.922481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 251/493] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:42.928306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cd1d0-0fc8-42e2-a754-c646f2cc3a38 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:43.062595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:43.066554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cd1d0-0fc8-42e2-a754-c646f2cc3a38 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:43.107870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76f0c-c61f-4dc1-8421-70414f2c9802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:43.108905 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76f0c-c61f-4dc1-8421-70414f2c9802 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:43.109387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76f0c-c61f-4dc1-8421-70414f2c9802 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:43.109859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76f0c-c61f-4dc1-8421-70414f2c9802 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:43.121987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e76f0c-c61f-4dc1-8421-70414f2c9802 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:43.123753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e76f0c-c61f-4dc1-8421-70414f2c9802 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e0e76f0c-c61f-4dc1-8421-70414f2c9802 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:43.146079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:43.147041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:43.147934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 243/494] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:21:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:43.157550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c594882-674d-47b4-b55d-158852ee4be6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:43.270292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:43.296123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c594882-674d-47b4-b55d-158852ee4be6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:43.341267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675593e-7490-42e3-a87a-ceafefefa6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:43.341875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675593e-7490-42e3-a87a-ceafefefa6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:43.342152 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675593e-7490-42e3-a87a-ceafefefa6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:43.342420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675593e-7490-42e3-a87a-ceafefefa6a2 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:43.343144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675593e-7490-42e3-a87a-ceafefefa6a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:43.343446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675593e-7490-42e3-a87a-ceafefefa6a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:43.344899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675593e-7490-42e3-a87a-ceafefefa6a2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:43.373265 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 252/495] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Nov 2 03:21:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:43.378897 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76f0c-c61f-4dc1-8421-70414f2c9802 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:43.516082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76f0c-c61f-4dc1-8421-70414f2c9802 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:43.566255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29705dcb-9ade-4971-9610-9f7c7209e631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:43.566884 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29705dcb-9ade-4971-9610-9f7c7209e631 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:43.567164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29705dcb-9ade-4971-9610-9f7c7209e631 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:43.567431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29705dcb-9ade-4971-9610-9f7c7209e631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:43.599402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:43.655944 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29705dcb-9ade-4971-9610-9f7c7209e631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:43.657338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29705dcb-9ade-4971-9610-9f7c7209e631 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:43.775366 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 244/496] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 03:21:43.781039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675593e-7490-42e3-a87a-ceafefefa6a2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:43.924304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675593e-7490-42e3-a87a-ceafefefa6a2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:43.972626 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c3f44-d422-4406-845d-5eece268372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:43.973258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c3f44-d422-4406-845d-5eece268372a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:43.973535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c3f44-d422-4406-845d-5eece268372a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:43.973802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c3f44-d422-4406-845d-5eece268372a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:43.981535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:43.989416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c3f44-d422-4406-845d-5eece268372a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:43.990883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c3f44-d422-4406-845d-5eece268372a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f74c3f44-d422-4406-845d-5eece268372a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:44.011685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:44.012949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:44.013803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:44.013803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:44.013803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:44.013803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 253/497] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:44.018383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29705dcb-9ade-4971-9610-9f7c7209e631 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:44.128589 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:44.187535 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29705dcb-9ade-4971-9610-9f7c7209e631 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:44.240245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1f45e-d688-49c7-bdde-3b987eecc23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:44.240891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1f45e-d688-49c7-bdde-3b987eecc23b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:44.241175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1f45e-d688-49c7-bdde-3b987eecc23b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:44.241453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1f45e-d688-49c7-bdde-3b987eecc23b None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:44.242096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1f45e-d688-49c7-bdde-3b987eecc23b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:44.242399 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1f45e-d688-49c7-bdde-3b987eecc23b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:44.243838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1f45e-d688-49c7-bdde-3b987eecc23b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:44.259800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 245/498] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:44.264597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c85d6-044c-4822-ae9a-56e0d6022b52 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:44.265100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c85d6-044c-4822-ae9a-56e0d6022b52 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:44.265571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c85d6-044c-4822-ae9a-56e0d6022b52 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:44.267360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 254/499] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:44.270081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1f45e-d688-49c7-bdde-3b987eecc23b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:44.272356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79f04b-0de6-4f09-9521-1b74374fa3ca None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:44.272684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79f04b-0de6-4f09-9521-1b74374fa3ca None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:44.272960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79f04b-0de6-4f09-9521-1b74374fa3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:44.296618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3f79f04b-0de6-4f09-9521-1b74374fa3ca None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:44.297842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3f79f04b-0de6-4f09-9521-1b74374fa3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:44.400587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 255/500] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:44.452504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1f45e-d688-49c7-bdde-3b987eecc23b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:44.476099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:44.496598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b20d5-939e-4403-bf18-0839fb7bd5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:44.497286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b20d5-939e-4403-bf18-0839fb7bd5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:44.497574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b20d5-939e-4403-bf18-0839fb7bd5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:44.497848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b20d5-939e-4403-bf18-0839fb7bd5e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:44.505131 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b20d5-939e-4403-bf18-0839fb7bd5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:44.506592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b20d5-939e-4403-bf18-0839fb7bd5e8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:44.511424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7d026-dcd4-440b-9a40-bf901d8cb4ce None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:44.511960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7d026-dcd4-440b-9a40-bf901d8cb4ce None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:44.512436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7d026-dcd4-440b-9a40-bf901d8cb4ce None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:44.514373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 256/501] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:44.519224 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba21df-7063-480d-9c69-a7fe6c620384 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-056b20d5-939e-4403-bf18-0839fb7bd5e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:44.519481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:44.520784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:44.521639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:44.521639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:44.521639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:44.521639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:44.521639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:44.521639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:44.521639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:44.521639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:44.521639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 246/502] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:44.522937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba21df-7063-480d-9c69-a7fe6c620384 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:44.523237 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba21df-7063-480d-9c69-a7fe6c620384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:44.533818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b20d5-939e-4403-bf18-0839fb7bd5e8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:44.564736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-43ba21df-7063-480d-9c69-a7fe6c620384 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:44.570977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-43ba21df-7063-480d-9c69-a7fe6c620384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:44.704666 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 257/503] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:44.724257 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b20d5-939e-4403-bf18-0839fb7bd5e8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:44.761255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867f303-e557-43d5-8c63-2a1b5c544941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:44.762233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f303-e557-43d5-8c63-2a1b5c544941 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:44.762781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f303-e557-43d5-8c63-2a1b5c544941 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:44.763265 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f303-e557-43d5-8c63-2a1b5c544941 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:44.764152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867f303-e557-43d5-8c63-2a1b5c544941 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:44.764687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867f303-e557-43d5-8c63-2a1b5c544941 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:44.766330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867f303-e557-43d5-8c63-2a1b5c544941 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:44.779231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba21df-7063-480d-9c69-a7fe6c620384 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:44.780241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 247/504] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:44.794746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867f303-e557-43d5-8c63-2a1b5c544941 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:44.848400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:44.909167 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867f303-e557-43d5-8c63-2a1b5c544941 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:44.928821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:44.949974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb3e65-72bd-4886-9a29-d6f55e340c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:44.953272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb3e65-72bd-4886-9a29-d6f55e340c68 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:44.953767 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb3e65-72bd-4886-9a29-d6f55e340c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:44.954261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb3e65-72bd-4886-9a29-d6f55e340c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:44.955342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb3e65-72bd-4886-9a29-d6f55e340c68 None admin] RBAC: Adding query filter params (role.id=2840a8ea5485428fad61d84f364bcecb, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=89782ff12f5c49da80c7568ccab38c13) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:44.956805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb3e65-72bd-4886-9a29-d6f55e340c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:44.958461 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb3e65-72bd-4886-9a29-d6f55e340c68 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:44.971847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 248/505] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:21:44 2022] GET /identity/v3/role_assignments?user.id=89782ff12f5c49da80c7568ccab38c13&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=2840a8ea5485428fad61d84f364bcecb => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:44.996414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284cd5d-d83c-4610-ab23-4747edaf20d7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:44.997103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284cd5d-d83c-4610-ab23-4747edaf20d7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:44.997580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284cd5d-d83c-4610-ab23-4747edaf20d7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:44.999607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 249/506] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:21:45.006954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba21df-7063-480d-9c69-a7fe6c620384 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:45.014480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c0353-3ced-4de4-adff-3b0103b7e18e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.015123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c0353-3ced-4de4-adff-3b0103b7e18e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.015603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c0353-3ced-4de4-adff-3b0103b7e18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.036957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3a6c0353-3ced-4de4-adff-3b0103b7e18e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:45.038512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3a6c0353-3ced-4de4-adff-3b0103b7e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:45.063391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5c73c-5246-409a-8095-7314acc76b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:45.064152 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5c73c-5246-409a-8095-7314acc76b2a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.064535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5c73c-5246-409a-8095-7314acc76b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.064911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5c73c-5246-409a-8095-7314acc76b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.077506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5c73c-5246-409a-8095-7314acc76b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:45.079326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5c73c-5246-409a-8095-7314acc76b2a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d9c5c73c-5246-409a-8095-7314acc76b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:45.096496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:45.097614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:45.099037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:45.099037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:45.099037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:45.099037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 258/507] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:45.099274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5c73c-5246-409a-8095-7314acc76b2a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:45.127576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 250/508] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:45.136977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c0353-3ced-4de4-adff-3b0103b7e18e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:45.194776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:45.233382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:45.236530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5c73c-5246-409a-8095-7314acc76b2a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:45.275954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24b85d-92a2-41a8-9fc9-cbd8324b2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:45.276854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24b85d-92a2-41a8-9fc9-cbd8324b2131 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.277273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24b85d-92a2-41a8-9fc9-cbd8324b2131 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.277673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24b85d-92a2-41a8-9fc9-cbd8324b2131 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.287387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c0353-3ced-4de4-adff-3b0103b7e18e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:45.292087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24b85d-92a2-41a8-9fc9-cbd8324b2131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3c24b85d-92a2-41a8-9fc9-cbd8324b2131 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:45.297792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:45.298909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:45.299957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:45.302124 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 259/509] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:21:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:45.308539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24b85d-92a2-41a8-9fc9-cbd8324b2131 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:45.337887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602119aa-3b04-4648-9c64-12148503221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:45.339121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602119aa-3b04-4648-9c64-12148503221c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.339502 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602119aa-3b04-4648-9c64-12148503221c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.340039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602119aa-3b04-4648-9c64-12148503221c None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.340965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602119aa-3b04-4648-9c64-12148503221c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:45.341367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602119aa-3b04-4648-9c64-12148503221c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:45.343815 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602119aa-3b04-4648-9c64-12148503221c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:45.359647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 251/510] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:45.365942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602119aa-3b04-4648-9c64-12148503221c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:45.428609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24b85d-92a2-41a8-9fc9-cbd8324b2131 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:45.465193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a74594-a387-4e5d-be5e-6ee603cf1a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:45.466138 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a74594-a387-4e5d-be5e-6ee603cf1a54 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.466618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a74594-a387-4e5d-be5e-6ee603cf1a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.467064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a74594-a387-4e5d-be5e-6ee603cf1a54 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.467934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a74594-a387-4e5d-be5e-6ee603cf1a54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:45.468494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a74594-a387-4e5d-be5e-6ee603cf1a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:45.470165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a74594-a387-4e5d-be5e-6ee603cf1a54 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:45.484581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:45.485922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 260/511] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:45.487060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a74594-a387-4e5d-be5e-6ee603cf1a54 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:45.490068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602119aa-3b04-4648-9c64-12148503221c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:45.519225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:45.538736 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea88bb-5d08-45a9-b9f1-00c5bb7d648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:45.540087 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea88bb-5d08-45a9-b9f1-00c5bb7d648b None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.540438 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea88bb-5d08-45a9-b9f1-00c5bb7d648b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.540809 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea88bb-5d08-45a9-b9f1-00c5bb7d648b None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.542192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea88bb-5d08-45a9-b9f1-00c5bb7d648b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:45.544150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea88bb-5d08-45a9-b9f1-00c5bb7d648b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:45.575929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 252/512] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:21:45 2022] POST /identity/v3/users => generated 254 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:45.578091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea88bb-5d08-45a9-b9f1-00c5bb7d648b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:45.640295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a74594-a387-4e5d-be5e-6ee603cf1a54 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:45.680965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4da61c-c657-4fcc-8b9b-199ae0ea394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:45.681914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4da61c-c657-4fcc-8b9b-199ae0ea394f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.682523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4da61c-c657-4fcc-8b9b-199ae0ea394f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.683001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4da61c-c657-4fcc-8b9b-199ae0ea394f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.683877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4da61c-c657-4fcc-8b9b-199ae0ea394f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:45.685521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4da61c-c657-4fcc-8b9b-199ae0ea394f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ca4da61c-c657-4fcc-8b9b-199ae0ea394f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:45.698984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:45.700095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 03:21:45.701231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:45.703809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 261/513] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Nov 2 03:21:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:45.705311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490a632-0936-4ad7-9ab8-6bbc8f8088c9 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.705750 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490a632-0936-4ad7-9ab8-6bbc8f8088c9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.706163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490a632-0936-4ad7-9ab8-6bbc8f8088c9 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.707907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 262/514] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:45.709874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490a632-0936-4ad7-9ab8-6bbc8f8088c9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:45.737085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea88bb-5d08-45a9-b9f1-00c5bb7d648b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:45.784937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a210a5f-e4f8-426a-a85b-5b70467b721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:45.785578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a210a5f-e4f8-426a-a85b-5b70467b721e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.785962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a210a5f-e4f8-426a-a85b-5b70467b721e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.786208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a210a5f-e4f8-426a-a85b-5b70467b721e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.799443 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a210a5f-e4f8-426a-a85b-5b70467b721e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:45.800752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a210a5f-e4f8-426a-a85b-5b70467b721e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:45.808900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:45.815628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-9a210a5f-e4f8-426a-a85b-5b70467b721e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:45.816898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:45.817802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:45.818695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:45.818695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:45.818695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:45.818695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 253/515] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:45.819632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cbe8e-9375-4e70-adb0-7b97d5bba93b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.820051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cbe8e-9375-4e70-adb0-7b97d5bba93b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.820244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cbe8e-9375-4e70-adb0-7b97d5bba93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.841140 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490a632-0936-4ad7-9ab8-6bbc8f8088c9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:45.842913 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-819cbe8e-9375-4e70-adb0-7b97d5bba93b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:45.844213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-819cbe8e-9375-4e70-adb0-7b97d5bba93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:45.880387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20271e6f-617e-4517-ba69-e0d749f75cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:45.881015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20271e6f-617e-4517-ba69-e0d749f75cef None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:45.881293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20271e6f-617e-4517-ba69-e0d749f75cef None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:45.881560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20271e6f-617e-4517-ba69-e0d749f75cef None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:45.882189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20271e6f-617e-4517-ba69-e0d749f75cef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:45.882488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20271e6f-617e-4517-ba69-e0d749f75cef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:45.884422 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20271e6f-617e-4517-ba69-e0d749f75cef None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:45.894669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 263/516] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Nov 2 03:21:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:45.895577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20271e6f-617e-4517-ba69-e0d749f75cef None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:45.923374 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 254/517] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:45.924594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cbe8e-9375-4e70-adb0-7b97d5bba93b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:46.030944 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cbe8e-9375-4e70-adb0-7b97d5bba93b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:46.062752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:46.069213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaaf12-07cb-4525-9596-81450faae151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:46.070079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaaf12-07cb-4525-9596-81450faae151 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:46.070631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaaf12-07cb-4525-9596-81450faae151 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:46.071108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaaf12-07cb-4525-9596-81450faae151 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:46.071941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdaaf12-07cb-4525-9596-81450faae151 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:46.072439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdaaf12-07cb-4525-9596-81450faae151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:46.074106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdaaf12-07cb-4525-9596-81450faae151 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:46.080526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 255/518] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Nov 2 03:21:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:46.085200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20271e6f-617e-4517-ba69-e0d749f75cef None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:46.137047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339249a-eb8c-4095-a093-32126b92e447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:46.138057 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339249a-eb8c-4095-a093-32126b92e447 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:46.138513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339249a-eb8c-4095-a093-32126b92e447 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:46.138960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339249a-eb8c-4095-a093-32126b92e447 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:46.139880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339249a-eb8c-4095-a093-32126b92e447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:46.140394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339249a-eb8c-4095-a093-32126b92e447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:46.142032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339249a-eb8c-4095-a093-32126b92e447 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:46.162336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 264/519] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:46.168066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaaf12-07cb-4525-9596-81450faae151 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:46.276828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaaf12-07cb-4525-9596-81450faae151 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:46.312719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874cf25-4484-4575-978d-76d5409773a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:46.313640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874cf25-4484-4575-978d-76d5409773a6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:46.314115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874cf25-4484-4575-978d-76d5409773a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:46.314566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874cf25-4484-4575-978d-76d5409773a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:46.323523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874cf25-4484-4575-978d-76d5409773a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:46.325287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874cf25-4484-4575-978d-76d5409773a6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b874cf25-4484-4575-978d-76d5409773a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:46.337287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:46.338273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:46.339182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:46.339182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:46.339182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:46.339182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:46.339182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:46.339182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:46.339182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:46.339182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:46.339182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:21:46.339182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:46.341783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 256/520] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Nov 2 03:21:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:46.349732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339249a-eb8c-4095-a093-32126b92e447 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:46.367255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:46.416100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874cf25-4484-4575-978d-76d5409773a6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:46.483573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339249a-eb8c-4095-a093-32126b92e447 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:46.488537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:46.551502 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fe514-db6e-4778-8cbe-eb89e6097f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:46.552106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fe514-db6e-4778-8cbe-eb89e6097f3f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:46.552381 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fe514-db6e-4778-8cbe-eb89e6097f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:46.552699 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fe514-db6e-4778-8cbe-eb89e6097f3f None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:46.553425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fe514-db6e-4778-8cbe-eb89e6097f3f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:46.553725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fe514-db6e-4778-8cbe-eb89e6097f3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:46.555415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fe514-db6e-4778-8cbe-eb89e6097f3f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:46.567214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874cf25-4484-4575-978d-76d5409773a6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:46.587990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 265/521] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Nov 2 03:21:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:46.593569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fe514-db6e-4778-8cbe-eb89e6097f3f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:46.629995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596c515-0581-45ef-be59-25fdf4eb49ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:46.630626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596c515-0581-45ef-be59-25fdf4eb49ef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:46.630893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596c515-0581-45ef-be59-25fdf4eb49ef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:46.631161 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596c515-0581-45ef-be59-25fdf4eb49ef None admin] PATH_INFO: `/v3/services/network` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:46.631736 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596c515-0581-45ef-be59-25fdf4eb49ef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:46.633255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596c515-0581-45ef-be59-25fdf4eb49ef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3596c515-0581-45ef-be59-25fdf4eb49ef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:46.648066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:46.649661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 03:21:46.650469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:46.657171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 257/522] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:46 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:46.660914 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596c515-0581-45ef-be59-25fdf4eb49ef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:46.716784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:46.773403 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fe514-db6e-4778-8cbe-eb89e6097f3f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:46.828833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3b7d3-73f9-4eac-a7cd-14bf9ce2ed80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:46.829378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b7d3-73f9-4eac-a7cd-14bf9ce2ed80 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:46.829655 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b7d3-73f9-4eac-a7cd-14bf9ce2ed80 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:46.829920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b7d3-73f9-4eac-a7cd-14bf9ce2ed80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:46.834537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596c515-0581-45ef-be59-25fdf4eb49ef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:46.843019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3b7d3-73f9-4eac-a7cd-14bf9ce2ed80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:46.844485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3b7d3-73f9-4eac-a7cd-14bf9ce2ed80 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-60a3b7d3-73f9-4eac-a7cd-14bf9ce2ed80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:46.870932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:46.872086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:46.873387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:46.873387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:46.873387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:46.873387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 266/523] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:46.882394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3b7d3-73f9-4eac-a7cd-14bf9ce2ed80 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:46.882665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:46.906624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bd2de-cd43-499b-b2d7-69e02c2d8a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:46.907239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bd2de-cd43-499b-b2d7-69e02c2d8a54 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:46.907515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bd2de-cd43-499b-b2d7-69e02c2d8a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:46.907787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bd2de-cd43-499b-b2d7-69e02c2d8a54 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:46.908483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bd2de-cd43-499b-b2d7-69e02c2d8a54 None admin] RBAC: Adding query filter params (name=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:46.908970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bd2de-cd43-499b-b2d7-69e02c2d8a54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:46.911033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bd2de-cd43-499b-b2d7-69e02c2d8a54 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:46.918615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 258/524] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:21:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:46.924673 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bd2de-cd43-499b-b2d7-69e02c2d8a54 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:47.076642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3b7d3-73f9-4eac-a7cd-14bf9ce2ed80 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:47.107219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bd2de-cd43-499b-b2d7-69e02c2d8a54 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:47.116829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:47.145622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f393157-e29b-4405-8400-02d83844d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:47.146232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f393157-e29b-4405-8400-02d83844d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:47.146505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f393157-e29b-4405-8400-02d83844d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:47.146768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f393157-e29b-4405-8400-02d83844d7b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:47.147416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f393157-e29b-4405-8400-02d83844d7b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:47.147722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f393157-e29b-4405-8400-02d83844d7b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:47.150065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f393157-e29b-4405-8400-02d83844d7b9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:47.170625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffc831-5a4a-44c7-8121-3011b77c1f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:47.171233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffc831-5a4a-44c7-8121-3011b77c1f8a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:47.171507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffc831-5a4a-44c7-8121-3011b77c1f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:47.171775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffc831-5a4a-44c7-8121-3011b77c1f8a None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:47.172400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffc831-5a4a-44c7-8121-3011b77c1f8a None admin] RBAC: Adding query filter params (type=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:47.172722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffc831-5a4a-44c7-8121-3011b77c1f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:47.174074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffc831-5a4a-44c7-8121-3011b77c1f8a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:47.176979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 267/525] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:47.181327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 259/526] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:21:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:47.194198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f393157-e29b-4405-8400-02d83844d7b9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:47.312890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f393157-e29b-4405-8400-02d83844d7b9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:47.372500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbac586-5b13-4729-9f38-a533e568ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:47.373383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac586-5b13-4729-9f38-a533e568ff15 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:47.373829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac586-5b13-4729-9f38-a533e568ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:47.374241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac586-5b13-4729-9f38-a533e568ff15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:47.382505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbac586-5b13-4729-9f38-a533e568ff15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:47.384267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbac586-5b13-4729-9f38-a533e568ff15 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-cfbac586-5b13-4729-9f38-a533e568ff15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:47.397037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:47.398147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:47.399753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:47.399753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:47.399753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:47.399753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:47.399753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:47.399753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:47.399753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:47.399753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:47.402035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 268/527] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:47.407997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffc831-5a4a-44c7-8121-3011b77c1f8a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:47.469812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:47.532209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffc831-5a4a-44c7-8121-3011b77c1f8a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:47.582332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d11af-64e7-4905-a0bb-6a63e041f231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:47.582991 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d11af-64e7-4905-a0bb-6a63e041f231 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:47.583272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d11af-64e7-4905-a0bb-6a63e041f231 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:47.583540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d11af-64e7-4905-a0bb-6a63e041f231 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:47.584230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d11af-64e7-4905-a0bb-6a63e041f231 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:47.584556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d11af-64e7-4905-a0bb-6a63e041f231 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:47.585973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d11af-64e7-4905-a0bb-6a63e041f231 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:47.589972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62690f45-d2ab-4634-a6ff-272476481c01 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:47.590258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62690f45-d2ab-4634-a6ff-272476481c01 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:47.590536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62690f45-d2ab-4634-a6ff-272476481c01 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:47.592096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 269/528] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:47.597173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238373c7-70ba-4b68-ad00-1fc9558776db None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:47.597455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238373c7-70ba-4b68-ad00-1fc9558776db None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:47.597729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238373c7-70ba-4b68-ad00-1fc9558776db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:47.605663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 260/529] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:47.616962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d11af-64e7-4905-a0bb-6a63e041f231 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:47.622071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-238373c7-70ba-4b68-ad00-1fc9558776db None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:47.623278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-238373c7-70ba-4b68-ad00-1fc9558776db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:47.660636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:47.716573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 270/530] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:21:47.783070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d11af-64e7-4905-a0bb-6a63e041f231 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:47.791143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:47.820125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1de8b8-85e1-4e82-a160-95b8d14cce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:47.822020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1de8b8-85e1-4e82-a160-95b8d14cce02 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:47.822508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1de8b8-85e1-4e82-a160-95b8d14cce02 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:47.823013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1de8b8-85e1-4e82-a160-95b8d14cce02 None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/35afc6fb66a649e2a9d22ee01cccbc53/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:47.825601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1de8b8-85e1-4e82-a160-95b8d14cce02 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=35afc6fb66a649e2a9d22ee01cccbc53, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:47.827105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1de8b8-85e1-4e82-a160-95b8d14cce02 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:47.841515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 261/531] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:21:47 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/35afc6fb66a649e2a9d22ee01cccbc53/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:21:48.151940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238373c7-70ba-4b68-ad00-1fc9558776db None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:48.280535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238373c7-70ba-4b68-ad00-1fc9558776db None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:48.295272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c484341-4084-4601-b61d-ae4544f95280 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:48.295561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c484341-4084-4601-b61d-ae4544f95280 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:48.295752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c484341-4084-4601-b61d-ae4544f95280 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:48.297371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 262/532] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:21:48.303573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0509446-88a2-4096-9170-3188a63312ba None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:48.303860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0509446-88a2-4096-9170-3188a63312ba None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:48.304139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0509446-88a2-4096-9170-3188a63312ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:48.326308 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d0509446-88a2-4096-9170-3188a63312ba None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:48.327865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d0509446-88a2-4096-9170-3188a63312ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:48.334545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28898815-b2cc-4b2d-86f1-ce0748b0c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:48.335470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28898815-b2cc-4b2d-86f1-ce0748b0c72f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:48.335950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28898815-b2cc-4b2d-86f1-ce0748b0c72f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:48.336488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28898815-b2cc-4b2d-86f1-ce0748b0c72f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:48.365178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28898815-b2cc-4b2d-86f1-ce0748b0c72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-28898815-b2cc-4b2d-86f1-ce0748b0c72f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:48.370951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:48.371854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:48.372711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:48.381456 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 271/533] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:21:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:48.382698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28898815-b2cc-4b2d-86f1-ce0748b0c72f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:48.406199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 263/534] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 03:21:48.448436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:48.544349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28898815-b2cc-4b2d-86f1-ce0748b0c72f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:48.588479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c93654-5acc-4cda-9769-8bf994a9ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:48.589012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93654-5acc-4cda-9769-8bf994a9ef10 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:48.589289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93654-5acc-4cda-9769-8bf994a9ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:48.589558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93654-5acc-4cda-9769-8bf994a9ef10 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:48.590218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c93654-5acc-4cda-9769-8bf994a9ef10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:48.590512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c93654-5acc-4cda-9769-8bf994a9ef10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:48.591870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c93654-5acc-4cda-9769-8bf994a9ef10 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:48.602244 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 272/535] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:48.608066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0509446-88a2-4096-9170-3188a63312ba None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:48.741958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c93654-5acc-4cda-9769-8bf994a9ef10 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:48.746163 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:48.757082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0509446-88a2-4096-9170-3188a63312ba None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:48.805865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7e0b5-b6e9-4030-afc1-bb78b3968957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:48.806500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7e0b5-b6e9-4030-afc1-bb78b3968957 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:48.806776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7e0b5-b6e9-4030-afc1-bb78b3968957 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:48.807045 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7e0b5-b6e9-4030-afc1-bb78b3968957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:48.826246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7e0b5-b6e9-4030-afc1-bb78b3968957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:48.827690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7e0b5-b6e9-4030-afc1-bb78b3968957 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-94e7e0b5-b6e9-4030-afc1-bb78b3968957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:48.857178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:48.858143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:48.859013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:48.859013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:48.859013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:48.862757 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 264/536] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:48.869916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccc11d-50f6-48cc-8e2f-2e52c27f7a76 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:48.870280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccc11d-50f6-48cc-8e2f-2e52c27f7a76 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:48.870678 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccc11d-50f6-48cc-8e2f-2e52c27f7a76 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:48.872162 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 265/537] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:48.873215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccc11d-50f6-48cc-8e2f-2e52c27f7a76 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:48.891684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:48.907388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c93654-5acc-4cda-9769-8bf994a9ef10 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:48.944706 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7ecda-c72e-40a6-be25-a14d6e228541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:48.945742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7ecda-c72e-40a6-be25-a14d6e228541 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:48.946228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7ecda-c72e-40a6-be25-a14d6e228541 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:48.946693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7ecda-c72e-40a6-be25-a14d6e228541 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:48.957518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7ecda-c72e-40a6-be25-a14d6e228541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-15b7ecda-c72e-40a6-be25-a14d6e228541 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:48.964076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:48.965095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:48.965922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:48.972839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 273/538] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:48.974083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c83c9-fa76-4833-bbd5-c3e2dcdfa0fc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:48.974365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c83c9-fa76-4833-bbd5-c3e2dcdfa0fc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:48.974639 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c83c9-fa76-4833-bbd5-c3e2dcdfa0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:48.998220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7c5c83c9-fa76-4833-bbd5-c3e2dcdfa0fc None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:48.999689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7c5c83c9-fa76-4833-bbd5-c3e2dcdfa0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:49.007623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccc11d-50f6-48cc-8e2f-2e52c27f7a76 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:49.044824 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566939c-c9b8-4e11-8547-b6b9a477b2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:49.046432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566939c-c9b8-4e11-8547-b6b9a477b2bc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:49.046908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566939c-c9b8-4e11-8547-b6b9a477b2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:49.047423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566939c-c9b8-4e11-8547-b6b9a477b2bc None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:49.048274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566939c-c9b8-4e11-8547-b6b9a477b2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:49.048792 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566939c-c9b8-4e11-8547-b6b9a477b2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:49.050596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566939c-c9b8-4e11-8547-b6b9a477b2bc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:49.065017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 266/539] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:49.066191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566939c-c9b8-4e11-8547-b6b9a477b2bc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:49.077787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:49.087190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 274/540] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:49.093093 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c83c9-fa76-4833-bbd5-c3e2dcdfa0fc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:49.239949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:49.263956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566939c-c9b8-4e11-8547-b6b9a477b2bc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:49.281509 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c83c9-fa76-4833-bbd5-c3e2dcdfa0fc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:49.313790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d76de7-8ec0-4346-b504-a75c339bfae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:49.314768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d76de7-8ec0-4346-b504-a75c339bfae2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:49.315312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d76de7-8ec0-4346-b504-a75c339bfae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:49.315786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d76de7-8ec0-4346-b504-a75c339bfae2 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:49.316679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d76de7-8ec0-4346-b504-a75c339bfae2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:49.317177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d76de7-8ec0-4346-b504-a75c339bfae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:49.318724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d76de7-8ec0-4346-b504-a75c339bfae2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:49.332332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 267/541] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:49.333866 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d76de7-8ec0-4346-b504-a75c339bfae2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:49.379300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74af479-588e-475c-96c4-910ad603345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:49.380112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af479-588e-475c-96c4-910ad603345d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:49.380294 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af479-588e-475c-96c4-910ad603345d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:49.380586 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af479-588e-475c-96c4-910ad603345d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:49.397538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74af479-588e-475c-96c4-910ad603345d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:49.399592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74af479-588e-475c-96c4-910ad603345d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:49.410792 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f74af479-588e-475c-96c4-910ad603345d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:49.420741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:49.421729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:49.422673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:49.422673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:49.422673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:49.422673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:49.422673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:49.422673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:49.422673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:49.422673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:49.422673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 03:21:49.422673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:49.424687 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 275/542] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:21:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:49.425506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74af479-588e-475c-96c4-910ad603345d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:49.450061 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d76de7-8ec0-4346-b504-a75c339bfae2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:49.487319 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c73a48-0fb9-4b59-b288-03d9a38aac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:49.488576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c73a48-0fb9-4b59-b288-03d9a38aac08 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:49.489643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c73a48-0fb9-4b59-b288-03d9a38aac08 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:49.490451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c73a48-0fb9-4b59-b288-03d9a38aac08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:49.502904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c73a48-0fb9-4b59-b288-03d9a38aac08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:49.505501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c73a48-0fb9-4b59-b288-03d9a38aac08 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c1c73a48-0fb9-4b59-b288-03d9a38aac08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:49.522679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:49.523738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:49.524627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:49.524627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:49.524627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:49.530582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 268/543] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:49.530582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c73a48-0fb9-4b59-b288-03d9a38aac08 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:49.545566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74af479-588e-475c-96c4-910ad603345d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:49.587710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78b609-463d-48a7-8a54-b7341abb5eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:49.589153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78b609-463d-48a7-8a54-b7341abb5eaf None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:49.589873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78b609-463d-48a7-8a54-b7341abb5eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:49.590393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78b609-463d-48a7-8a54-b7341abb5eaf None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:49.591448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78b609-463d-48a7-8a54-b7341abb5eaf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:49.593326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78b609-463d-48a7-8a54-b7341abb5eaf None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:49.617604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 276/544] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:21:49 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:49.619685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78b609-463d-48a7-8a54-b7341abb5eaf None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:49.624825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:49.694698 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c73a48-0fb9-4b59-b288-03d9a38aac08 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:49.746912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:49.797842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e95fc1-297d-4b2b-acbe-6991b7831114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:49.798465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e95fc1-297d-4b2b-acbe-6991b7831114 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:49.798743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e95fc1-297d-4b2b-acbe-6991b7831114 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:49.799009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e95fc1-297d-4b2b-acbe-6991b7831114 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:49.800847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e95fc1-297d-4b2b-acbe-6991b7831114 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:49.801153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e95fc1-297d-4b2b-acbe-6991b7831114 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:49.804234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e95fc1-297d-4b2b-acbe-6991b7831114 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:49.824981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 269/545] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Nov 2 03:21:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:49.830689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e95fc1-297d-4b2b-acbe-6991b7831114 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:49.857524 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78b609-463d-48a7-8a54-b7341abb5eaf None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:49.899613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c2784-abad-4bf0-8d08-39d6925fada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:49.900281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c2784-abad-4bf0-8d08-39d6925fada4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:49.900883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c2784-abad-4bf0-8d08-39d6925fada4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:49.900883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c2784-abad-4bf0-8d08-39d6925fada4 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:49.901486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c2784-abad-4bf0-8d08-39d6925fada4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:49.901782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c2784-abad-4bf0-8d08-39d6925fada4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:49.903160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c2784-abad-4bf0-8d08-39d6925fada4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:49.915668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 277/546] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:49.916750 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d942a0-5f55-4094-939b-3c9f09154b41 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:49.917039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d942a0-5f55-4094-939b-3c9f09154b41 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:49.917310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d942a0-5f55-4094-939b-3c9f09154b41 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:49.918916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 278/547] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:49.922445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d942a0-5f55-4094-939b-3c9f09154b41 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:49.972485 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e95fc1-297d-4b2b-acbe-6991b7831114 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:50.003663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:50.013707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049aa4f-432c-40de-ba15-d01818e25366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:50.014628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049aa4f-432c-40de-ba15-d01818e25366 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.014984 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049aa4f-432c-40de-ba15-d01818e25366 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.015328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049aa4f-432c-40de-ba15-d01818e25366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.026597 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049aa4f-432c-40de-ba15-d01818e25366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:50.028407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049aa4f-432c-40de-ba15-d01818e25366 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1049aa4f-432c-40de-ba15-d01818e25366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:50.051194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:50.052137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:50.053115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:50.053115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:50.053115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:50.053115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 270/548] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:50.053988 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7f39-a72f-4f54-a4ab-bb82450a522b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.053988 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7f39-a72f-4f54-a4ab-bb82450a522b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.059350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7f39-a72f-4f54-a4ab-bb82450a522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.066172 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d942a0-5f55-4094-939b-3c9f09154b41 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:50.084019 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-538e7f39-a72f-4f54-a4ab-bb82450a522b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:50.085770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-538e7f39-a72f-4f54-a4ab-bb82450a522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:50.105785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed6222-b02d-4f38-97c3-638006659ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:50.106470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6222-b02d-4f38-97c3-638006659ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.106902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6222-b02d-4f38-97c3-638006659ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.107121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6222-b02d-4f38-97c3-638006659ba9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.115278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:50.116371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed6222-b02d-4f38-97c3-638006659ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:50.118115 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed6222-b02d-4f38-97c3-638006659ba9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e4ed6222-b02d-4f38-97c3-638006659ba9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:50.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:50.133974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 279/549] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Nov 2 03:21:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:50.135564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed6222-b02d-4f38-97c3-638006659ba9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:50.170539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 271/550] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 03:21:50.171842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e7f39-a72f-4f54-a4ab-bb82450a522b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:50.312223 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed6222-b02d-4f38-97c3-638006659ba9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:50.324106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e7f39-a72f-4f54-a4ab-bb82450a522b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:50.372541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab252cbe-b1ab-45a8-b8a3-594852a682df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:50.373167 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252cbe-b1ab-45a8-b8a3-594852a682df None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.373454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252cbe-b1ab-45a8-b8a3-594852a682df None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.373727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252cbe-b1ab-45a8-b8a3-594852a682df None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.374475 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab252cbe-b1ab-45a8-b8a3-594852a682df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:50.374781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab252cbe-b1ab-45a8-b8a3-594852a682df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:50.376214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab252cbe-b1ab-45a8-b8a3-594852a682df None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:50.380959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:50.405490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc7f81-3e12-4c44-9cb5-08b3035c0414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:50.406158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc7f81-3e12-4c44-9cb5-08b3035c0414 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.406438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc7f81-3e12-4c44-9cb5-08b3035c0414 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.406710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc7f81-3e12-4c44-9cb5-08b3035c0414 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.407408 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc7f81-3e12-4c44-9cb5-08b3035c0414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:50.407713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc7f81-3e12-4c44-9cb5-08b3035c0414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:50.409107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc7f81-3e12-4c44-9cb5-08b3035c0414 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:50.415936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 272/551] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Nov 2 03:21:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:50.422541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab252cbe-b1ab-45a8-b8a3-594852a682df None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:50.437067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 280/552] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:50.442779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc7f81-3e12-4c44-9cb5-08b3035c0414 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:50.452638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:50.543326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab252cbe-b1ab-45a8-b8a3-594852a682df None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:50.562858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc7f81-3e12-4c44-9cb5-08b3035c0414 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:50.581964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a75f0-bd0b-46f2-94f7-00aac136b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:50.582590 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a75f0-bd0b-46f2-94f7-00aac136b663 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.582867 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a75f0-bd0b-46f2-94f7-00aac136b663 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.583136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a75f0-bd0b-46f2-94f7-00aac136b663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.593393 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a75f0-bd0b-46f2-94f7-00aac136b663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:50.594834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a75f0-bd0b-46f2-94f7-00aac136b663 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:50.599816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03678e2-bbc4-4d80-ac8f-55f1323f3cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:50.600448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03678e2-bbc4-4d80-ac8f-55f1323f3cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.600752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03678e2-bbc4-4d80-ac8f-55f1323f3cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.601022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03678e2-bbc4-4d80-ac8f-55f1323f3cc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.607829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03678e2-bbc4-4d80-ac8f-55f1323f3cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:50.609299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03678e2-bbc4-4d80-ac8f-55f1323f3cc6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fb0a75f0-bd0b-46f2-94f7-00aac136b663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:50.610135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:50.611039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:50.611906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:50.611906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:50.611906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:50.611906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 273/553] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:50.612738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f21e7c-7ed7-410e-976d-ffef6dacbe7b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.612936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f21e7c-7ed7-410e-976d-ffef6dacbe7b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.613380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f21e7c-7ed7-410e-976d-ffef6dacbe7b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.616565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 274/554] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:50.616565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f21e7c-7ed7-410e-976d-ffef6dacbe7b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f03678e2-bbc4-4d80-ac8f-55f1323f3cc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:50.626234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:50.627295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:50.628255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:50.628255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:50.628255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:50.628255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:50.628255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:50.628255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:50.628255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:50.628255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:50.628255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 281/555] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:50.628255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03678e2-bbc4-4d80-ac8f-55f1323f3cc6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:50.676420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:50.696746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:50.738779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03678e2-bbc4-4d80-ac8f-55f1323f3cc6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:50.740104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f21e7c-7ed7-410e-976d-ffef6dacbe7b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:50.776098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3723b76-a4ec-417f-9bb2-83773e122bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:50.776727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3723b76-a4ec-417f-9bb2-83773e122bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.777010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3723b76-a4ec-417f-9bb2-83773e122bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.777284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3723b76-a4ec-417f-9bb2-83773e122bb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.777918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3723b76-a4ec-417f-9bb2-83773e122bb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:50.778217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3723b76-a4ec-417f-9bb2-83773e122bb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:50.779695 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3723b76-a4ec-417f-9bb2-83773e122bb8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:50.779924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff89323-5e0e-4553-a75e-812b2ff39a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:50.780695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff89323-5e0e-4553-a75e-812b2ff39a16 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.781248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff89323-5e0e-4553-a75e-812b2ff39a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.781526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff89323-5e0e-4553-a75e-812b2ff39a16 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.782711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff89323-5e0e-4553-a75e-812b2ff39a16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:50.784044 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff89323-5e0e-4553-a75e-812b2ff39a16 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:50.792673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 282/556] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:50.794273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93ae7a-3696-492f-b4b5-a679ca4c94ee None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:50.794729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93ae7a-3696-492f-b4b5-a679ca4c94ee None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:50.795069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93ae7a-3696-492f-b4b5-a679ca4c94ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:50.804222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 275/557] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:21:50 2022] POST /identity/v3/services => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:50.809474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff89323-5e0e-4553-a75e-812b2ff39a16 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:50.818289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1d93ae7a-3696-492f-b4b5-a679ca4c94ee None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:50.819946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1d93ae7a-3696-492f-b4b5-a679ca4c94ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:50.930776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 283/558] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:21:50.932006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93ae7a-3696-492f-b4b5-a679ca4c94ee None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:50.946429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff89323-5e0e-4553-a75e-812b2ff39a16 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:50.967096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:51.002122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:51.014470 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc68dd0-13f8-4b7f-9d4d-55d7b0306556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:51.015088 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc68dd0-13f8-4b7f-9d4d-55d7b0306556 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:51.015366 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc68dd0-13f8-4b7f-9d4d-55d7b0306556 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:51.015635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc68dd0-13f8-4b7f-9d4d-55d7b0306556 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:51.016329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc68dd0-13f8-4b7f-9d4d-55d7b0306556 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:51.016673 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc68dd0-13f8-4b7f-9d4d-55d7b0306556 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:51.018124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc68dd0-13f8-4b7f-9d4d-55d7b0306556 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:51.034302 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 276/559] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:51.040584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc68dd0-13f8-4b7f-9d4d-55d7b0306556 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:51.103492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93ae7a-3696-492f-b4b5-a679ca4c94ee None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:51.153035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59babe5b-01ea-4ff5-b2ec-fcc281377117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:51.153666 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59babe5b-01ea-4ff5-b2ec-fcc281377117 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:51.153942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59babe5b-01ea-4ff5-b2ec-fcc281377117 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:51.154211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59babe5b-01ea-4ff5-b2ec-fcc281377117 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:51.163355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59babe5b-01ea-4ff5-b2ec-fcc281377117 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:51.165737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59babe5b-01ea-4ff5-b2ec-fcc281377117 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:51.177754 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc68dd0-13f8-4b7f-9d4d-55d7b0306556 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-59babe5b-01ea-4ff5-b2ec-fcc281377117 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:51.190371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:51.191289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:51.192215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:51.192215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:51.192215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:51.192215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:51.192215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:51.192215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:51.192215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:51.192215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:51.196987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 284/560] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:51.202482 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59babe5b-01ea-4ff5-b2ec-fcc281377117 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:51.221087 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71a23-b92c-4f40-b79a-50cb5d6b7294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:51.222107 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71a23-b92c-4f40-b79a-50cb5d6b7294 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:51.222648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71a23-b92c-4f40-b79a-50cb5d6b7294 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:51.223121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71a23-b92c-4f40-b79a-50cb5d6b7294 None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/89782ff12f5c49da80c7568ccab38c13/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:51.225412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d71a23-b92c-4f40-b79a-50cb5d6b7294 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=89782ff12f5c49da80c7568ccab38c13, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:51.227173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d71a23-b92c-4f40-b79a-50cb5d6b7294 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:51.252243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 277/561] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:21:51 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/89782ff12f5c49da80c7568ccab38c13/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:51.333356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:51.349493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59babe5b-01ea-4ff5-b2ec-fcc281377117 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:51.354673 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71a23-b92c-4f40-b79a-50cb5d6b7294 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:51.394604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6357-f563-4116-8f97-201ea949d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:51.395674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6357-f563-4116-8f97-201ea949d110 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:51.396161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6357-f563-4116-8f97-201ea949d110 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:51.396664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6357-f563-4116-8f97-201ea949d110 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:51.398893 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6357-f563-4116-8f97-201ea949d110 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:51.399443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6357-f563-4116-8f97-201ea949d110 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:51.401249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6357-f563-4116-8f97-201ea949d110 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:51.417105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 285/562] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:51.425687 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6357-f563-4116-8f97-201ea949d110 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:51.457505 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:51.549666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71a23-b92c-4f40-b79a-50cb5d6b7294 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:51.597339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6357-f563-4116-8f97-201ea949d110 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:51.614405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b57808-b6fc-44dd-b0a0-aaaeafa8347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:51.614955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b57808-b6fc-44dd-b0a0-aaaeafa8347b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:51.615234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b57808-b6fc-44dd-b0a0-aaaeafa8347b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:51.615503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b57808-b6fc-44dd-b0a0-aaaeafa8347b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:51.636609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b57808-b6fc-44dd-b0a0-aaaeafa8347b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-31b57808-b6fc-44dd-b0a0-aaaeafa8347b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:51.642584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:51.643519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:51.644334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:51.650047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 278/563] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:21:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:51.651414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b57808-b6fc-44dd-b0a0-aaaeafa8347b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:51.675061 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5b0f-0193-4ab0-a5f6-300b87a8dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:51.675737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5b0f-0193-4ab0-a5f6-300b87a8dac6 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:51.676023 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5b0f-0193-4ab0-a5f6-300b87a8dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:51.676303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5b0f-0193-4ab0-a5f6-300b87a8dac6 None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/8937e32b919e4f5882ec84250147cbcd/roles/2840a8ea5485428fad61d84f364bcecb` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:51.709049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5b0f-0193-4ab0-a5f6-300b87a8dac6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=8937e32b919e4f5882ec84250147cbcd, role_id=2840a8ea5485428fad61d84f364bcecb)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:51.713940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5b0f-0193-4ab0-a5f6-300b87a8dac6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:51.739263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:51.742034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 286/564] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:21:51 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/8937e32b919e4f5882ec84250147cbcd/roles/2840a8ea5485428fad61d84f364bcecb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:21:51.833561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b57808-b6fc-44dd-b0a0-aaaeafa8347b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:51.850015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:51.879894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf84dc0-45c9-459e-9124-d3a9f6ecb20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:51.880859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf84dc0-45c9-459e-9124-d3a9f6ecb20f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:51.881341 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf84dc0-45c9-459e-9124-d3a9f6ecb20f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:51.881812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf84dc0-45c9-459e-9124-d3a9f6ecb20f None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:51.882723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf84dc0-45c9-459e-9124-d3a9f6ecb20f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:51.883239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf84dc0-45c9-459e-9124-d3a9f6ecb20f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:51.884862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf84dc0-45c9-459e-9124-d3a9f6ecb20f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:51.894694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 279/565] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:51.901657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5b0f-0193-4ab0-a5f6-300b87a8dac6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:52.070891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5b0f-0193-4ab0-a5f6-300b87a8dac6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:52.119607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c5a2e-5b12-4350-9f3a-af2058d13e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:52.120615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5a2e-5b12-4350-9f3a-af2058d13e3c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:52.121094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5a2e-5b12-4350-9f3a-af2058d13e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:52.121596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5a2e-5b12-4350-9f3a-af2058d13e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:52.143863 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c5a2e-5b12-4350-9f3a-af2058d13e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:52.145753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c5a2e-5b12-4350-9f3a-af2058d13e3c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3a7c5a2e-5b12-4350-9f3a-af2058d13e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:52.164682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:52.165793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:52.166645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:52.166645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:52.166645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:52.168492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 287/566] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:52.174147 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf84dc0-45c9-459e-9124-d3a9f6ecb20f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:52.177528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e486ab7-e347-44b5-b85d-88b85e58cd4c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:52.177875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e486ab7-e347-44b5-b85d-88b85e58cd4c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:52.178100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e486ab7-e347-44b5-b85d-88b85e58cd4c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:52.180088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 288/567] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:21:52.188491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7089c34-8c2f-47fd-b543-668b6a9ef43e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:52.188491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7089c34-8c2f-47fd-b543-668b6a9ef43e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:52.188491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7089c34-8c2f-47fd-b543-668b6a9ef43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:52.210257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d7089c34-8c2f-47fd-b543-668b6a9ef43e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:52.214070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d7089c34-8c2f-47fd-b543-668b6a9ef43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:52.307364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:52.345387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 289/568] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:21:52.356388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf84dc0-45c9-459e-9124-d3a9f6ecb20f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:52.399294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d7c0-7bdd-48aa-86cd-e9d073d3f7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:52.399641 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d7c0-7bdd-48aa-86cd-e9d073d3f7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:52.399923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d7c0-7bdd-48aa-86cd-e9d073d3f7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:52.400196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178d7c0-7bdd-48aa-86cd-e9d073d3f7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:52.400870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178d7c0-7bdd-48aa-86cd-e9d073d3f7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:52.401176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178d7c0-7bdd-48aa-86cd-e9d073d3f7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:52.402534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178d7c0-7bdd-48aa-86cd-e9d073d3f7f9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:52.423810 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 280/569] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:52.429343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7089c34-8c2f-47fd-b543-668b6a9ef43e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:52.566992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7089c34-8c2f-47fd-b543-668b6a9ef43e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:52.603559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0a3b8-dd55-4f4f-8d10-c6c07930533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:52.604196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0a3b8-dd55-4f4f-8d10-c6c07930533b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:52.604492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0a3b8-dd55-4f4f-8d10-c6c07930533b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:52.604772 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0a3b8-dd55-4f4f-8d10-c6c07930533b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:52.612042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0a3b8-dd55-4f4f-8d10-c6c07930533b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:52.613516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0a3b8-dd55-4f4f-8d10-c6c07930533b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-eea0a3b8-dd55-4f4f-8d10-c6c07930533b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:52.625556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:52.626503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:52.627451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 290/570] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Nov 2 03:21:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:52.634069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d7c0-7bdd-48aa-86cd-e9d073d3f7f9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:52.682766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:52.717459 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0a3b8-dd55-4f4f-8d10-c6c07930533b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:52.764596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178d7c0-7bdd-48aa-86cd-e9d073d3f7f9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:52.788185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:52.802868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb03e1-f4c3-43b7-8784-8cf3f8861629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:52.803645 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb03e1-f4c3-43b7-8784-8cf3f8861629 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:52.804022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb03e1-f4c3-43b7-8784-8cf3f8861629 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:52.804430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb03e1-f4c3-43b7-8784-8cf3f8861629 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:52.806510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb03e1-f4c3-43b7-8784-8cf3f8861629 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:52.806890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb03e1-f4c3-43b7-8784-8cf3f8861629 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:52.808388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb03e1-f4c3-43b7-8784-8cf3f8861629 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:52.827292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 281/571] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Nov 2 03:21:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:52.832739 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb03e1-f4c3-43b7-8784-8cf3f8861629 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:52.936588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:52.945275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0a3b8-dd55-4f4f-8d10-c6c07930533b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:52.953398 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb03e1-f4c3-43b7-8784-8cf3f8861629 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:53.003974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0477c17-b3dd-44fa-9359-634fa544797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:53.005160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477c17-b3dd-44fa-9359-634fa544797b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.005443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477c17-b3dd-44fa-9359-634fa544797b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.005715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477c17-b3dd-44fa-9359-634fa544797b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.006294 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0477c17-b3dd-44fa-9359-634fa544797b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:53.007705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0477c17-b3dd-44fa-9359-634fa544797b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:53.012617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a34a3-9316-4ba3-9598-c72cda0ae9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:53.013288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a34a3-9316-4ba3-9598-c72cda0ae9fb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.013566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a34a3-9316-4ba3-9598-c72cda0ae9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.013835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a34a3-9316-4ba3-9598-c72cda0ae9fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-c0477c17-b3dd-44fa-9359-634fa544797b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:53.022632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:53.023676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 03:21:53.024565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:53.025296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 291/572] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Nov 2 03:21:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:53.035318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0477c17-b3dd-44fa-9359-634fa544797b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:53.115785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a34a3-9316-4ba3-9598-c72cda0ae9fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:53.117929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a34a3-9316-4ba3-9598-c72cda0ae9fb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:53.220754 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:53.237865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 282/573] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 03:21:53.243546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a34a3-9316-4ba3-9598-c72cda0ae9fb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:53.278349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0477c17-b3dd-44fa-9359-634fa544797b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:53.284933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:53.363652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056856c6-1c07-411b-8c9a-ed06fc1b6571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:53.364746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056856c6-1c07-411b-8c9a-ed06fc1b6571 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.364839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056856c6-1c07-411b-8c9a-ed06fc1b6571 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.365060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056856c6-1c07-411b-8c9a-ed06fc1b6571 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.365697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056856c6-1c07-411b-8c9a-ed06fc1b6571 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:53.366001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056856c6-1c07-411b-8c9a-ed06fc1b6571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:53.367707 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056856c6-1c07-411b-8c9a-ed06fc1b6571 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:53.375786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 292/574] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Nov 2 03:21:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:53.381451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056856c6-1c07-411b-8c9a-ed06fc1b6571 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:53.427223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a34a3-9316-4ba3-9598-c72cda0ae9fb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:53.476262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a670a-caf3-47e0-91bd-3149076a654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:53.477521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a670a-caf3-47e0-91bd-3149076a654e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.478111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a670a-caf3-47e0-91bd-3149076a654e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.480774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a670a-caf3-47e0-91bd-3149076a654e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.504434 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a670a-caf3-47e0-91bd-3149076a654e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:53.509195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a670a-caf3-47e0-91bd-3149076a654e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c79a670a-caf3-47e0-91bd-3149076a654e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:53.533224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:53.534197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:53.535074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:53.535074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:53.535074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:53.537558 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 283/575] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:53.539113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab05d2-8569-4497-90a2-9e69a70715b5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.539646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab05d2-8569-4497-90a2-9e69a70715b5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.540140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab05d2-8569-4497-90a2-9e69a70715b5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.541852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 284/576] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:53.543852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab05d2-8569-4497-90a2-9e69a70715b5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:53.572974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056856c6-1c07-411b-8c9a-ed06fc1b6571 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:53.598440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:53.620360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce4650-d5fd-48c7-95f9-8ea0c880b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:53.621551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4650-d5fd-48c7-95f9-8ea0c880b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.622450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4650-d5fd-48c7-95f9-8ea0c880b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.623065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4650-d5fd-48c7-95f9-8ea0c880b3c8 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.624082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce4650-d5fd-48c7-95f9-8ea0c880b3c8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:53.624841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce4650-d5fd-48c7-95f9-8ea0c880b3c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:53.627083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce4650-d5fd-48c7-95f9-8ea0c880b3c8 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:53.635824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 293/577] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Nov 2 03:21:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:53.637251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db2e4d-18f8-4b20-b05f-3b26724451b2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.637737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db2e4d-18f8-4b20-b05f-3b26724451b2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.638186 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db2e4d-18f8-4b20-b05f-3b26724451b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.661918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-90db2e4d-18f8-4b20-b05f-3b26724451b2 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:53.664200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-90db2e4d-18f8-4b20-b05f-3b26724451b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:53.670565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab05d2-8569-4497-90a2-9e69a70715b5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:53.697963 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:53.715194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df12a4-7535-401e-a3ce-a0f8254ee669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:53.716060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df12a4-7535-401e-a3ce-a0f8254ee669 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.716632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df12a4-7535-401e-a3ce-a0f8254ee669 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.717177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df12a4-7535-401e-a3ce-a0f8254ee669 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.718001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df12a4-7535-401e-a3ce-a0f8254ee669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:53.718791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df12a4-7535-401e-a3ce-a0f8254ee669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:53.720350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df12a4-7535-401e-a3ce-a0f8254ee669 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:53.740624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 285/578] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:53.741854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df12a4-7535-401e-a3ce-a0f8254ee669 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:53.764866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 294/579] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:21:53.765992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db2e4d-18f8-4b20-b05f-3b26724451b2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:53.861952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:53.866403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df12a4-7535-401e-a3ce-a0f8254ee669 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:53.911560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5e87f-cc4c-4738-903e-2e4d7bddaf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:53.912828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5e87f-cc4c-4738-903e-2e4d7bddaf44 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.913342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5e87f-cc4c-4738-903e-2e4d7bddaf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.914601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5e87f-cc4c-4738-903e-2e4d7bddaf44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.915556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5e87f-cc4c-4738-903e-2e4d7bddaf44 None admin] RBAC: Adding query filter params (interface=public, service_id=f5819b799f634ceebba46326ff2054cf, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:53.916375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5e87f-cc4c-4738-903e-2e4d7bddaf44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:53.918414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5e87f-cc4c-4738-903e-2e4d7bddaf44 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:53.924975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db2e4d-18f8-4b20-b05f-3b26724451b2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:53.929252 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 286/580] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Nov 2 03:21:53 2022] GET /identity/v3/endpoints?service_id=f5819b799f634ceebba46326ff2054cf&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:53.930832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a900-6310-4aae-9d17-efec2ff85839 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.931324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a900-6310-4aae-9d17-efec2ff85839 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.931816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a900-6310-4aae-9d17-efec2ff85839 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.933964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 287/581] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:53.934880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a900-6310-4aae-9d17-efec2ff85839 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:53.969644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c12494-87c8-46a8-a9fe-da6dc0503278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:53.971061 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12494-87c8-46a8-a9fe-da6dc0503278 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:53.971732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12494-87c8-46a8-a9fe-da6dc0503278 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:53.972179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12494-87c8-46a8-a9fe-da6dc0503278 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:53.981735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c12494-87c8-46a8-a9fe-da6dc0503278 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:53.983432 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c12494-87c8-46a8-a9fe-da6dc0503278 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d3c12494-87c8-46a8-a9fe-da6dc0503278 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:53.996303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:53.997406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:53.998561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:53.998561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:53.998561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:53.998561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:53.998561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:53.998561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:53.998561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:53.998561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:53.999023 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 295/582] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:54.005014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885015b-10dd-445e-aa9a-bccaf8848df5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.005368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885015b-10dd-445e-aa9a-bccaf8848df5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.005718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885015b-10dd-445e-aa9a-bccaf8848df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.026778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7885015b-10dd-445e-aa9a-bccaf8848df5 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:54.028124 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7885015b-10dd-445e-aa9a-bccaf8848df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:54.053936 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:54.069941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a900-6310-4aae-9d17-efec2ff85839 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:54.109531 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8bca-e587-4297-8ffb-11f7d1cd56e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:54.110078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8bca-e587-4297-8ffb-11f7d1cd56e3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.110356 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8bca-e587-4297-8ffb-11f7d1cd56e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.110628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8bca-e587-4297-8ffb-11f7d1cd56e3 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.111211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d8bca-e587-4297-8ffb-11f7d1cd56e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:54.112625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d8bca-e587-4297-8ffb-11f7d1cd56e3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:54.118406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 296/583] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:21:54.119150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885015b-10dd-445e-aa9a-bccaf8848df5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:54.125369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 288/584] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Nov 2 03:21:53 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:54.126533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8bca-e587-4297-8ffb-11f7d1cd56e3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:54.172890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:54.281384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8bca-e587-4297-8ffb-11f7d1cd56e3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:54.321816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885015b-10dd-445e-aa9a-bccaf8848df5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:54.332256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca6a20-141a-4511-a9fc-643de42b54aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:54.333017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca6a20-141a-4511-a9fc-643de42b54aa None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.333305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca6a20-141a-4511-a9fc-643de42b54aa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.333574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca6a20-141a-4511-a9fc-643de42b54aa None admin] PATH_INFO: `/v3/services/network` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.334165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca6a20-141a-4511-a9fc-643de42b54aa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:54.335545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca6a20-141a-4511-a9fc-643de42b54aa None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-29ca6a20-141a-4511-a9fc-643de42b54aa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:54.348666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:54.349765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:54.350642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 289/585] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:54 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:54.356360 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca6a20-141a-4511-a9fc-643de42b54aa None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:54.391244 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ef968-eb3f-4694-87e8-31f3434f1507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:54.391923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ef968-eb3f-4694-87e8-31f3434f1507 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.392983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ef968-eb3f-4694-87e8-31f3434f1507 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.392983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ef968-eb3f-4694-87e8-31f3434f1507 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.393190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ef968-eb3f-4694-87e8-31f3434f1507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:54.393353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ef968-eb3f-4694-87e8-31f3434f1507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:54.394779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ef968-eb3f-4694-87e8-31f3434f1507 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:54.410134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 297/586] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:54.410975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ef968-eb3f-4694-87e8-31f3434f1507 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:54.428871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:54.468904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:54.479801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca6a20-141a-4511-a9fc-643de42b54aa None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:54.514971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ef968-eb3f-4694-87e8-31f3434f1507 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:54.517445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe3a5-4b41-4938-83ac-4c0d26892316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:54.518057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe3a5-4b41-4938-83ac-4c0d26892316 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.518337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe3a5-4b41-4938-83ac-4c0d26892316 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.518607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe3a5-4b41-4938-83ac-4c0d26892316 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.519228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe3a5-4b41-4938-83ac-4c0d26892316 None admin] RBAC: Adding query filter params (name=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:54.519532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe3a5-4b41-4938-83ac-4c0d26892316 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:54.520935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe3a5-4b41-4938-83ac-4c0d26892316 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:54.530474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 290/587] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:21:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:54.530474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe3a5-4b41-4938-83ac-4c0d26892316 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:54.554683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c372347-c2a4-49a8-bc14-6858665f6661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:54.555232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c372347-c2a4-49a8-bc14-6858665f6661 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.555512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c372347-c2a4-49a8-bc14-6858665f6661 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.555782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c372347-c2a4-49a8-bc14-6858665f6661 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.565870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c372347-c2a4-49a8-bc14-6858665f6661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3c372347-c2a4-49a8-bc14-6858665f6661 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:54.571628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:54.572616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:54.574088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 298/588] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:21:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:54.574812 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8ae6-931b-44ab-a2b5-e4f53785f751 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.574812 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8ae6-931b-44ab-a2b5-e4f53785f751 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.574812 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8ae6-931b-44ab-a2b5-e4f53785f751 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.577902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 299/589] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:54.577902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff8ae6-931b-44ab-a2b5-e4f53785f751 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:54.641226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe3a5-4b41-4938-83ac-4c0d26892316 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:54.651444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:54.679294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d5c05-195b-4227-b754-176ce07a9716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:54.680150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5c05-195b-4227-b754-176ce07a9716 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.680427 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5c05-195b-4227-b754-176ce07a9716 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.680718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5c05-195b-4227-b754-176ce07a9716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.681496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d5c05-195b-4227-b754-176ce07a9716 None admin] RBAC: Adding query filter params (role.id=9a4fa7f48c24440cae54bb4ec26b5b49, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=35afc6fb66a649e2a9d22ee01cccbc53) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:54.681805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d5c05-195b-4227-b754-176ce07a9716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:54.683215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d5c05-195b-4227-b754-176ce07a9716 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:54.683604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff8ae6-931b-44ab-a2b5-e4f53785f751 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:54.696552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 291/590] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:21:54 2022] GET /identity/v3/role_assignments?user.id=35afc6fb66a649e2a9d22ee01cccbc53&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=9a4fa7f48c24440cae54bb4ec26b5b49 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:54.696552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c45d2-762d-448c-a863-fd072e644afd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.696552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c45d2-762d-448c-a863-fd072e644afd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.696552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c45d2-762d-448c-a863-fd072e644afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.718653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7c7c45d2-762d-448c-a863-fd072e644afd None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:54.720007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7c7c45d2-762d-448c-a863-fd072e644afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:54.724764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2a13c-2de6-4aa6-bae0-197545891d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:54.725526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2a13c-2de6-4aa6-bae0-197545891d22 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.725872 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2a13c-2de6-4aa6-bae0-197545891d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.726253 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2a13c-2de6-4aa6-bae0-197545891d22 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.727584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2a13c-2de6-4aa6-bae0-197545891d22 None admin] RBAC: Adding query filter params (type=network) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:54.727813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2a13c-2de6-4aa6-bae0-197545891d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:54.729565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2a13c-2de6-4aa6-bae0-197545891d22 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:54.735682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 300/591] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:21:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:54.736729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2a13c-2de6-4aa6-bae0-197545891d22 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:54.743456 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:54.808610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 292/592] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:21:54.809865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c45d2-762d-448c-a863-fd072e644afd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:54.905584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2a13c-2de6-4aa6-bae0-197545891d22 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:54.963028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377b701-081a-4238-b45f-bfeb49ad9e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:54.963642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377b701-081a-4238-b45f-bfeb49ad9e7a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:54.963920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377b701-081a-4238-b45f-bfeb49ad9e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:54.964196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377b701-081a-4238-b45f-bfeb49ad9e7a None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:54.964881 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377b701-081a-4238-b45f-bfeb49ad9e7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:54.965181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377b701-081a-4238-b45f-bfeb49ad9e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:54.966571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377b701-081a-4238-b45f-bfeb49ad9e7a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:54.969473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:54.976246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c45d2-762d-448c-a863-fd072e644afd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:54.977644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 301/593] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:21:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:54.985481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377b701-081a-4238-b45f-bfeb49ad9e7a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:55.021386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980b563-8569-4de5-80f3-1ec90fdd4ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:55.022383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b563-8569-4de5-80f3-1ec90fdd4ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:55.022917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b563-8569-4de5-80f3-1ec90fdd4ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:55.023904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b563-8569-4de5-80f3-1ec90fdd4ca4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:55.024770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980b563-8569-4de5-80f3-1ec90fdd4ca4 None admin] RBAC: Adding query filter params (interface=public, service_id=8a74fbd9c610471c9b2893ed85b5ebeb, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:55.025268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980b563-8569-4de5-80f3-1ec90fdd4ca4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:55.027055 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980b563-8569-4de5-80f3-1ec90fdd4ca4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:55.033904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 293/594] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Nov 2 03:21:54 2022] GET /identity/v3/endpoints?service_id=8a74fbd9c610471c9b2893ed85b5ebeb&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:55.040486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980b563-8569-4de5-80f3-1ec90fdd4ca4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:55.069879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:55.149267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377b701-081a-4238-b45f-bfeb49ad9e7a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:55.192931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7897821-1145-40ed-8965-de3d24e9f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:55.193563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7897821-1145-40ed-8965-de3d24e9f3fb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:55.194098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7897821-1145-40ed-8965-de3d24e9f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:55.194373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7897821-1145-40ed-8965-de3d24e9f3fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:55.200736 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980b563-8569-4de5-80f3-1ec90fdd4ca4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:55.207896 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7897821-1145-40ed-8965-de3d24e9f3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:55.209893 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7897821-1145-40ed-8965-de3d24e9f3fb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b7897821-1145-40ed-8965-de3d24e9f3fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:55.231887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:55.233073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:55.234708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:55.234708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:55.234708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:55.234708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 302/595] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:55.235176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7897821-1145-40ed-8965-de3d24e9f3fb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:55.238579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95147d-5c44-40c7-a284-28b0c56cfce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:55.239524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95147d-5c44-40c7-a284-28b0c56cfce1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:55.239862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95147d-5c44-40c7-a284-28b0c56cfce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:55.240194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95147d-5c44-40c7-a284-28b0c56cfce1 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:55.240913 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95147d-5c44-40c7-a284-28b0c56cfce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:55.242876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95147d-5c44-40c7-a284-28b0c56cfce1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:55.248717 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 294/596] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Nov 2 03:21:55 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:55.249563 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95147d-5c44-40c7-a284-28b0c56cfce1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:55.308304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:55.373881 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7897821-1145-40ed-8965-de3d24e9f3fb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:55.416991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a0087-060b-4500-8f2d-d2e4941e558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:55.417992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a0087-060b-4500-8f2d-d2e4941e558e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:55.418255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a0087-060b-4500-8f2d-d2e4941e558e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:55.418551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a0087-060b-4500-8f2d-d2e4941e558e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:55.431205 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a0087-060b-4500-8f2d-d2e4941e558e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-592a0087-060b-4500-8f2d-d2e4941e558e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:21:55.436746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:55.438891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:21:55.440875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:55.448777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 303/597] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:21:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:55.449939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a0087-060b-4500-8f2d-d2e4941e558e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:55.458410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:55.487450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95147d-5c44-40c7-a284-28b0c56cfce1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:55.553428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d3d21-4257-4e90-9ec7-3aec2a429479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:55.554044 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3d21-4257-4e90-9ec7-3aec2a429479 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:55.554323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3d21-4257-4e90-9ec7-3aec2a429479 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:55.554708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3d21-4257-4e90-9ec7-3aec2a429479 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:55.555359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d3d21-4257-4e90-9ec7-3aec2a429479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:55.555663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d3d21-4257-4e90-9ec7-3aec2a429479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:55.557655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d3d21-4257-4e90-9ec7-3aec2a429479 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:55.571751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 295/598] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:55.579652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d3d21-4257-4e90-9ec7-3aec2a429479 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:55.611197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a0087-060b-4500-8f2d-d2e4941e558e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:55.625702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:55.661693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664bbcf-5a0f-48b9-9b78-c52388cb92a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:55.662694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664bbcf-5a0f-48b9-9b78-c52388cb92a4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:55.664222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664bbcf-5a0f-48b9-9b78-c52388cb92a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:55.665521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664bbcf-5a0f-48b9-9b78-c52388cb92a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:55.667098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664bbcf-5a0f-48b9-9b78-c52388cb92a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:55.669834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664bbcf-5a0f-48b9-9b78-c52388cb92a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:55.671451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664bbcf-5a0f-48b9-9b78-c52388cb92a4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:55.689109 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 304/599] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:21:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:55.697635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664bbcf-5a0f-48b9-9b78-c52388cb92a4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:55.719355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d3d21-4257-4e90-9ec7-3aec2a429479 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:55.756952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af772c-735b-4c06-9734-2a1e7ef23b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:55.757674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af772c-735b-4c06-9734-2a1e7ef23b48 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:55.757957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af772c-735b-4c06-9734-2a1e7ef23b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:55.758230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af772c-735b-4c06-9734-2a1e7ef23b48 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:55.766842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af772c-735b-4c06-9734-2a1e7ef23b48 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:55.768271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af772c-735b-4c06-9734-2a1e7ef23b48 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:55.770062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-67af772c-735b-4c06-9734-2a1e7ef23b48 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:55.781327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:55.782448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:55.783565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:55.783565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:55.783565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:55.783565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:55.783565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:55.783565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:55.783565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:55.783565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:55.783565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 03:21:55.783565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:55.785747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 296/600] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:21:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:55.791539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af772c-735b-4c06-9734-2a1e7ef23b48 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:55.905557 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664bbcf-5a0f-48b9-9b78-c52388cb92a4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:55.973310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d742b-9224-47c2-850b-239f7f44090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:55.974095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d742b-9224-47c2-850b-239f7f44090a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:55.974571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d742b-9224-47c2-850b-239f7f44090a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:55.974940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d742b-9224-47c2-850b-239f7f44090a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:55.978542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af772c-735b-4c06-9734-2a1e7ef23b48 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:55.998558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d742b-9224-47c2-850b-239f7f44090a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:55.999912 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d742b-9224-47c2-850b-239f7f44090a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ff7d742b-9224-47c2-850b-239f7f44090a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:56.020815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:56.021779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:56.023041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:56.023041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:56.023041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:56.023041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 305/601] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:56.027909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d742b-9224-47c2-850b-239f7f44090a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:56.032771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d793ffb-8c4e-41eb-9b58-62ba2eac4429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:56.033662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d793ffb-8c4e-41eb-9b58-62ba2eac4429 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:56.034152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d793ffb-8c4e-41eb-9b58-62ba2eac4429 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:56.034636 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d793ffb-8c4e-41eb-9b58-62ba2eac4429 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:56.035563 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d793ffb-8c4e-41eb-9b58-62ba2eac4429 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:56.036062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d793ffb-8c4e-41eb-9b58-62ba2eac4429 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:56.038153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d793ffb-8c4e-41eb-9b58-62ba2eac4429 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:56.080854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:56.088280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 297/602] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Nov 2 03:21:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:56.093725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d793ffb-8c4e-41eb-9b58-62ba2eac4429 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:56.158060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d742b-9224-47c2-850b-239f7f44090a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:56.197339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d21898-ab59-40af-ae33-e27dafce6eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:56.200017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d21898-ab59-40af-ae33-e27dafce6eef None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:56.200583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d21898-ab59-40af-ae33-e27dafce6eef None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:56.203942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d21898-ab59-40af-ae33-e27dafce6eef None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:56.204942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d21898-ab59-40af-ae33-e27dafce6eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:56.205448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d21898-ab59-40af-ae33-e27dafce6eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:56.207123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d21898-ab59-40af-ae33-e27dafce6eef None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:56.222357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:56.234947 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 306/603] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:56.240598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d21898-ab59-40af-ae33-e27dafce6eef None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:56.270618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d793ffb-8c4e-41eb-9b58-62ba2eac4429 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:56.341449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831049-3937-4cd3-a015-0fdddae7d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:56.342072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831049-3937-4cd3-a015-0fdddae7d531 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:56.342347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831049-3937-4cd3-a015-0fdddae7d531 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:56.342614 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831049-3937-4cd3-a015-0fdddae7d531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:56.405664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:56.442269 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d21898-ab59-40af-ae33-e27dafce6eef None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:56.465952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831049-3937-4cd3-a015-0fdddae7d531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:56.467452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831049-3937-4cd3-a015-0fdddae7d531 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:56.524500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca5b73-9193-454c-a2b6-e529a60848a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:56.525124 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca5b73-9193-454c-a2b6-e529a60848a0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:56.525401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca5b73-9193-454c-a2b6-e529a60848a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:56.525672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca5b73-9193-454c-a2b6-e529a60848a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:56.540275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca5b73-9193-454c-a2b6-e529a60848a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:56.541762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca5b73-9193-454c-a2b6-e529a60848a0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:56.546559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-6eca5b73-9193-454c-a2b6-e529a60848a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:21:56.562282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:56.563263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:56.564184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:56.564184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:56.564184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:21:56.564184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:21:56.564184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:21:56.564184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:21:56.564184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:21:56.564184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:21:56.564184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 03:21:56.564184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:56.571507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 307/604] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Nov 2 03:21:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:56.576586 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca5b73-9193-454c-a2b6-e529a60848a0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:56.619934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 298/605] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 03:21:56.621803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f53921-7c41-41a3-a8b6-e736d56e5740 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:56.622297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f53921-7c41-41a3-a8b6-e736d56e5740 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:56.622770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f53921-7c41-41a3-a8b6-e736d56e5740 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:56.629205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 299/606] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:56.629336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f53921-7c41-41a3-a8b6-e736d56e5740 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:56.700723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca5b73-9193-454c-a2b6-e529a60848a0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:56.747047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d204a19-3bcb-4701-a43d-77918b8a7686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:56.747665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d204a19-3bcb-4701-a43d-77918b8a7686 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:56.747949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d204a19-3bcb-4701-a43d-77918b8a7686 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:56.748227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d204a19-3bcb-4701-a43d-77918b8a7686 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:56.749187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d204a19-3bcb-4701-a43d-77918b8a7686 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:56.749496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d204a19-3bcb-4701-a43d-77918b8a7686 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:56.751589 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d204a19-3bcb-4701-a43d-77918b8a7686 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:56.764361 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f53921-7c41-41a3-a8b6-e736d56e5740 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:56.773715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 308/607] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Nov 2 03:21:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:56.775421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5c9cc-41bf-444c-ac2f-211e4678e521 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:56.775975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5c9cc-41bf-444c-ac2f-211e4678e521 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:56.776449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5c9cc-41bf-444c-ac2f-211e4678e521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:56.783499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:56.799132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6bf5c9cc-41bf-444c-ac2f-211e4678e521 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:56.800766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6bf5c9cc-41bf-444c-ac2f-211e4678e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:56.802933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d09ea7-a949-497d-aa9c-0290f7a8a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:56.803613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d09ea7-a949-497d-aa9c-0290f7a8a08d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:56.803900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d09ea7-a949-497d-aa9c-0290f7a8a08d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:56.804180 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d09ea7-a949-497d-aa9c-0290f7a8a08d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:56.815242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d09ea7-a949-497d-aa9c-0290f7a8a08d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:56.816737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d09ea7-a949-497d-aa9c-0290f7a8a08d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-98d09ea7-a949-497d-aa9c-0290f7a8a08d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:56.833797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:56.834802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:56.835761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:56.835761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:56.835761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:56.835761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 300/608] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:56.835761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d09ea7-a949-497d-aa9c-0290f7a8a08d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:56.853141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:56.892084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 309/609] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:21:56.893153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5c9cc-41bf-444c-ac2f-211e4678e521 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:56.978710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d09ea7-a949-497d-aa9c-0290f7a8a08d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:57.054318 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0e5fc-1c9e-4c13-92bc-3ac2859e377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:57.054975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0e5fc-1c9e-4c13-92bc-3ac2859e377b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.055261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0e5fc-1c9e-4c13-92bc-3ac2859e377b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.055529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0e5fc-1c9e-4c13-92bc-3ac2859e377b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.089899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5c9cc-41bf-444c-ac2f-211e4678e521 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:57.149682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:57.154581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0e5fc-1c9e-4c13-92bc-3ac2859e377b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:57.156073 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0e5fc-1c9e-4c13-92bc-3ac2859e377b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:57.160249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d3cbb-65bd-41a9-8cda-3f31a9d31d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:57.160958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d3cbb-65bd-41a9-8cda-3f31a9d31d2d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.161288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d3cbb-65bd-41a9-8cda-3f31a9d31d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.161561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d3cbb-65bd-41a9-8cda-3f31a9d31d2d None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.162208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d3cbb-65bd-41a9-8cda-3f31a9d31d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:57.162506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d3cbb-65bd-41a9-8cda-3f31a9d31d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:57.164064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d3cbb-65bd-41a9-8cda-3f31a9d31d2d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:57.167794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:57.191075 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 310/610] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:57.206399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d3cbb-65bd-41a9-8cda-3f31a9d31d2d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:57.297397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 301/611] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:21:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 03:21:57.302743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0e5fc-1c9e-4c13-92bc-3ac2859e377b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:57.362719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d3cbb-65bd-41a9-8cda-3f31a9d31d2d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:57.400527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884dac0-8f2d-45fe-911e-bb984782c736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:57.401269 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884dac0-8f2d-45fe-911e-bb984782c736 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.401553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884dac0-8f2d-45fe-911e-bb984782c736 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.401827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884dac0-8f2d-45fe-911e-bb984782c736 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.409062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884dac0-8f2d-45fe-911e-bb984782c736 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:57.410503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884dac0-8f2d-45fe-911e-bb984782c736 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:57.416421 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0e5fc-1c9e-4c13-92bc-3ac2859e377b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-0884dac0-8f2d-45fe-911e-bb984782c736 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:57.422299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:57.423235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:57.424177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:57.424177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:57.424177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:57.424177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:57.424177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:57.424177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:57.424177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:57.424177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:57.424177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 311/612] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:57.424732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884dac0-8f2d-45fe-911e-bb984782c736 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:57.432615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:57.461198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc42c7-a76f-4b99-8a99-57f0c00594e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:57.461837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc42c7-a76f-4b99-8a99-57f0c00594e7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.462122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc42c7-a76f-4b99-8a99-57f0c00594e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.462391 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc42c7-a76f-4b99-8a99-57f0c00594e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.472591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc42c7-a76f-4b99-8a99-57f0c00594e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:57.474016 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc42c7-a76f-4b99-8a99-57f0c00594e7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:57.485775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f2bc42c7-a76f-4b99-8a99-57f0c00594e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:21:57.489270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:57.490522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:21:57.491624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:21:57.491624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:21:57.491624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:57.495588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 302/613] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:21:57.496868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599f7a9-39c9-4686-b9be-ae332066212c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.497150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599f7a9-39c9-4686-b9be-ae332066212c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.497423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599f7a9-39c9-4686-b9be-ae332066212c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.498641 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 303/614] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:57.503099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599f7a9-39c9-4686-b9be-ae332066212c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:57.543952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884dac0-8f2d-45fe-911e-bb984782c736 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:57.580689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65046845-e108-4377-972e-0d43a7e42aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:57.581244 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65046845-e108-4377-972e-0d43a7e42aed None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.581526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65046845-e108-4377-972e-0d43a7e42aed None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.581800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65046845-e108-4377-972e-0d43a7e42aed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.582866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65046845-e108-4377-972e-0d43a7e42aed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:57.584605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65046845-e108-4377-972e-0d43a7e42aed None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-65046845-e108-4377-972e-0d43a7e42aed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:57.595133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:57.596164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:57.597375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 312/615] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Nov 2 03:21:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:57.598174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65046845-e108-4377-972e-0d43a7e42aed None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:57.615284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599f7a9-39c9-4686-b9be-ae332066212c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:57.659346 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33094da0-bd93-486e-960d-9d6617580085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:57.659976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33094da0-bd93-486e-960d-9d6617580085 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.660338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33094da0-bd93-486e-960d-9d6617580085 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.660648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33094da0-bd93-486e-960d-9d6617580085 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.661504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33094da0-bd93-486e-960d-9d6617580085 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:57.661813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33094da0-bd93-486e-960d-9d6617580085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:57.663397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33094da0-bd93-486e-960d-9d6617580085 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:57.681812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 304/616] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:57.681812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfc81e-0f3f-4772-a5d6-87baa9146b00 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.681812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfc81e-0f3f-4772-a5d6-87baa9146b00 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.681812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfc81e-0f3f-4772-a5d6-87baa9146b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.698670 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8ebfc81e-0f3f-4772-a5d6-87baa9146b00 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:57.700031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8ebfc81e-0f3f-4772-a5d6-87baa9146b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:57.708729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65046845-e108-4377-972e-0d43a7e42aed None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:57.717961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:57.726595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:57.746476 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fb546-539b-43c0-8378-b3053e44920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:57.747085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fb546-539b-43c0-8378-b3053e44920e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.747368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fb546-539b-43c0-8378-b3053e44920e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.747643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fb546-539b-43c0-8378-b3053e44920e None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.748283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fb546-539b-43c0-8378-b3053e44920e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:57.748619 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fb546-539b-43c0-8378-b3053e44920e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:57.750019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fb546-539b-43c0-8378-b3053e44920e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:57.762000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 313/617] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:57.762791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fb546-539b-43c0-8378-b3053e44920e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:57.779245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 305/618] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:21:57.780073 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfc81e-0f3f-4772-a5d6-87baa9146b00 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:57.863628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fb546-539b-43c0-8378-b3053e44920e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:57.898797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c7840-8b00-479c-a57b-c332faa18b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:57.899485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c7840-8b00-479c-a57b-c332faa18b94 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.899768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c7840-8b00-479c-a57b-c332faa18b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.900035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c7840-8b00-479c-a57b-c332faa18b94 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.900689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c7840-8b00-479c-a57b-c332faa18b94 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:57.900991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c7840-8b00-479c-a57b-c332faa18b94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:57.902349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c7840-8b00-479c-a57b-c332faa18b94 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:57.903187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfc81e-0f3f-4772-a5d6-87baa9146b00 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:57.911862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 314/619] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Nov 2 03:21:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:57.912956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe650ed-4835-4e5b-ade7-68a413379ed5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.913249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe650ed-4835-4e5b-ade7-68a413379ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.913525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe650ed-4835-4e5b-ade7-68a413379ed5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.919241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 315/620] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:21:57.919241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe650ed-4835-4e5b-ade7-68a413379ed5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:57.941659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3c9f3-45aa-46a3-8a03-01a5e7e91579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:57.942268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3c9f3-45aa-46a3-8a03-01a5e7e91579 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:57.942545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3c9f3-45aa-46a3-8a03-01a5e7e91579 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:57.942820 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3c9f3-45aa-46a3-8a03-01a5e7e91579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:57.943531 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3c9f3-45aa-46a3-8a03-01a5e7e91579 None admin] RBAC: Adding query filter params (role.id=9a4fa7f48c24440cae54bb4ec26b5b49, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=89782ff12f5c49da80c7568ccab38c13) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:57.943841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3c9f3-45aa-46a3-8a03-01a5e7e91579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:57.946405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3c9f3-45aa-46a3-8a03-01a5e7e91579 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:57.952285 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 306/621] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:21:57 2022] GET /identity/v3/role_assignments?user.id=89782ff12f5c49da80c7568ccab38c13&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=9a4fa7f48c24440cae54bb4ec26b5b49 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:57.953073 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3c9f3-45aa-46a3-8a03-01a5e7e91579 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:57.975126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:57.977644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:58.071994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe650ed-4835-4e5b-ade7-68a413379ed5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:58.089860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3c9f3-45aa-46a3-8a03-01a5e7e91579 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:58.110756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b5b47-5549-4222-9b55-3cd6aaedb327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:58.111657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b5b47-5549-4222-9b55-3cd6aaedb327 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:58.112107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b5b47-5549-4222-9b55-3cd6aaedb327 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:58.112596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b5b47-5549-4222-9b55-3cd6aaedb327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:58.121788 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b5b47-5549-4222-9b55-3cd6aaedb327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:58.123630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b5b47-5549-4222-9b55-3cd6aaedb327 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:58.129405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569873fb-c732-407c-81f1-6a19858df578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:58.130026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569873fb-c732-407c-81f1-6a19858df578 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:58.130305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569873fb-c732-407c-81f1-6a19858df578 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:58.130576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569873fb-c732-407c-81f1-6a19858df578 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:58.131209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569873fb-c732-407c-81f1-6a19858df578 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:58.131507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569873fb-c732-407c-81f1-6a19858df578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:58.133001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569873fb-c732-407c-81f1-6a19858df578 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:58.138248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 307/622] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Nov 2 03:21:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-582b5b47-5549-4222-9b55-3cd6aaedb327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:21:58.138720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:58.139566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:58.140453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:21:58.140453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:21:58.140453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:21:58.140453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:21:58.140453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:21:58.140453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:21:58.140453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:21:58.140453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:58.140923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb964d5-2cea-4bc5-897e-9b2e32e4cc2b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:58.140923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb964d5-2cea-4bc5-897e-9b2e32e4cc2b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:58.140923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb964d5-2cea-4bc5-897e-9b2e32e4cc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:58.146824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 316/623] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:58.147894 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b5b47-5549-4222-9b55-3cd6aaedb327 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:58.163914 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0eb964d5-2cea-4bc5-897e-9b2e32e4cc2b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:21:58.165014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0eb964d5-2cea-4bc5-897e-9b2e32e4cc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:21:58.239915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 308/624] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:21:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:21:58.240805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb964d5-2cea-4bc5-897e-9b2e32e4cc2b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:58.251746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:58.271541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:58.276559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b5b47-5549-4222-9b55-3cd6aaedb327 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:58.321536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df51ce-48ac-4906-9f40-edef93a39f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:58.322608 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df51ce-48ac-4906-9f40-edef93a39f92 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:58.323516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df51ce-48ac-4906-9f40-edef93a39f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:58.324026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df51ce-48ac-4906-9f40-edef93a39f92 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:58.325251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df51ce-48ac-4906-9f40-edef93a39f92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:58.327651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df51ce-48ac-4906-9f40-edef93a39f92 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-33df51ce-48ac-4906-9f40-edef93a39f92 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:58.339961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:58.341356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:21:58.347727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 317/625] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Nov 2 03:21:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:58.348999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df51ce-48ac-4906-9f40-edef93a39f92 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:58.358723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb964d5-2cea-4bc5-897e-9b2e32e4cc2b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:58.406426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26907fb6-9973-4cce-b25e-aef274a21c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:58.407492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26907fb6-9973-4cce-b25e-aef274a21c86 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:58.408136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26907fb6-9973-4cce-b25e-aef274a21c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:58.408963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26907fb6-9973-4cce-b25e-aef274a21c86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:58.410145 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26907fb6-9973-4cce-b25e-aef274a21c86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:58.412613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26907fb6-9973-4cce-b25e-aef274a21c86 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:58.456485 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 309/626] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:21:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:21:58.456485 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26907fb6-9973-4cce-b25e-aef274a21c86 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:58.464254 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df51ce-48ac-4906-9f40-edef93a39f92 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:58.515981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81833f-244d-4f63-a715-7ea4e7f1fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:58.516840 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81833f-244d-4f63-a715-7ea4e7f1fac0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:58.517103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81833f-244d-4f63-a715-7ea4e7f1fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:58.517374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81833f-244d-4f63-a715-7ea4e7f1fac0 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:58.518448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81833f-244d-4f63-a715-7ea4e7f1fac0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:58.518756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81833f-244d-4f63-a715-7ea4e7f1fac0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:58.520280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81833f-244d-4f63-a715-7ea4e7f1fac0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:58.534921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 318/627] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:21:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:58.541729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81833f-244d-4f63-a715-7ea4e7f1fac0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:58.548870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:58.592898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:58.609274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26907fb6-9973-4cce-b25e-aef274a21c86 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:58.652426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60080e62-0998-4ec0-8b2f-d16168d3efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:58.653460 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60080e62-0998-4ec0-8b2f-d16168d3efcc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:58.654166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60080e62-0998-4ec0-8b2f-d16168d3efcc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:58.654658 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60080e62-0998-4ec0-8b2f-d16168d3efcc None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:58.656387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60080e62-0998-4ec0-8b2f-d16168d3efcc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:58.657006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60080e62-0998-4ec0-8b2f-d16168d3efcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:58.658632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60080e62-0998-4ec0-8b2f-d16168d3efcc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:58.670245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 310/628] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:21:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:58.671469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60080e62-0998-4ec0-8b2f-d16168d3efcc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:58.694731 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81833f-244d-4f63-a715-7ea4e7f1fac0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:58.749656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2afaf-023f-4f4c-bafc-7b3ceff626ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:58.750266 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2afaf-023f-4f4c-bafc-7b3ceff626ce None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:58.750544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2afaf-023f-4f4c-bafc-7b3ceff626ce None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:58.750816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2afaf-023f-4f4c-bafc-7b3ceff626ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:58.751539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2afaf-023f-4f4c-bafc-7b3ceff626ce None admin] RBAC: Adding query filter params (role.id=2840a8ea5485428fad61d84f364bcecb, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=8937e32b919e4f5882ec84250147cbcd) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:58.751854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2afaf-023f-4f4c-bafc-7b3ceff626ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:58.753463 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2afaf-023f-4f4c-bafc-7b3ceff626ce None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:58.760055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 319/629] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:21:58 2022] GET /identity/v3/role_assignments?user.id=8937e32b919e4f5882ec84250147cbcd&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=2840a8ea5485428fad61d84f364bcecb => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:21:58.764576 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2afaf-023f-4f4c-bafc-7b3ceff626ce None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:58.850323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60080e62-0998-4ec0-8b2f-d16168d3efcc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:58.908137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:58.908875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:58.924202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2afaf-023f-4f4c-bafc-7b3ceff626ce None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:58.937222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af6c28-b25b-43f5-b83d-f6b083f03f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:58.938534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6c28-b25b-43f5-b83d-f6b083f03f7e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:58.939236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6c28-b25b-43f5-b83d-f6b083f03f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:58.939658 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6c28-b25b-43f5-b83d-f6b083f03f7e None admin] PATH_INFO: `/v3/services/network` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:58.940397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af6c28-b25b-43f5-b83d-f6b083f03f7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:58.941929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af6c28-b25b-43f5-b83d-f6b083f03f7e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-43af6c28-b25b-43f5-b83d-f6b083f03f7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:21:58.959458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:21:58.961227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 03:21:58.962085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:21:58.967569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 311/630] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:21:58 2022] GET /identity/v3/services/network => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:21:58.970363 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af6c28-b25b-43f5-b83d-f6b083f03f7e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:58.985890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a211c-6e04-448d-b016-56342e934a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:58.986565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a211c-6e04-448d-b016-56342e934a13 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:58.987668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a211c-6e04-448d-b016-56342e934a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:58.987954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a211c-6e04-448d-b016-56342e934a13 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:58.988998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a211c-6e04-448d-b016-56342e934a13 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:58.989336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a211c-6e04-448d-b016-56342e934a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:58.990799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a211c-6e04-448d-b016-56342e934a13 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:58.998225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 320/631] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:21:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:59.103439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af6c28-b25b-43f5-b83d-f6b083f03f7e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:59.143661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e69b7-37cd-452f-a408-2225d47ef841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:59.144282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e69b7-37cd-452f-a408-2225d47ef841 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:59.144649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e69b7-37cd-452f-a408-2225d47ef841 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:59.144925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e69b7-37cd-452f-a408-2225d47ef841 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:59.145617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e69b7-37cd-452f-a408-2225d47ef841 None admin] RBAC: Adding query filter params (name=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:59.145926 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e69b7-37cd-452f-a408-2225d47ef841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:59.147299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e69b7-37cd-452f-a408-2225d47ef841 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:59.153377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 312/632] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:21:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:59.159290 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a211c-6e04-448d-b016-56342e934a13 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:59.278943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a211c-6e04-448d-b016-56342e934a13 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:59.334538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fecb95-0693-4f02-82a4-0dac4e1ab510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:59.335323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecb95-0693-4f02-82a4-0dac4e1ab510 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:59.335683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecb95-0693-4f02-82a4-0dac4e1ab510 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:59.336617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecb95-0693-4f02-82a4-0dac4e1ab510 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:59.337325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fecb95-0693-4f02-82a4-0dac4e1ab510 None admin] RBAC: Adding query filter params (type=network) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:21:59.337635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fecb95-0693-4f02-82a4-0dac4e1ab510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:59.339063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fecb95-0693-4f02-82a4-0dac4e1ab510 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:59.348641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 321/633] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:21:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:21:59.349881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e69b7-37cd-452f-a408-2225d47ef841 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:21:59.440487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:21:59.502469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e69b7-37cd-452f-a408-2225d47ef841 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:21:59.542594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3df0e6-0f63-471c-85f2-24b992fe65c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:21:59.543196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3df0e6-0f63-471c-85f2-24b992fe65c8 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:21:59.543472 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3df0e6-0f63-471c-85f2-24b992fe65c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:21:59.543737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3df0e6-0f63-471c-85f2-24b992fe65c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:21:59.544404 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3df0e6-0f63-471c-85f2-24b992fe65c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:21:59.545784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3df0e6-0f63-471c-85f2-24b992fe65c8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:21:59.576230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 313/634] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:21:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:00.336078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87407-6639-4edf-b325-5248dfddb31e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:00.336612 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87407-6639-4edf-b325-5248dfddb31e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:00.336612 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87407-6639-4edf-b325-5248dfddb31e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:00.338155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 322/635] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:00.343462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369ce7-37d2-4f3d-b48b-9acb456e5cd7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:00.343748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369ce7-37d2-4f3d-b48b-9acb456e5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:00.344018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369ce7-37d2-4f3d-b48b-9acb456e5cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:00.361931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f1369ce7-37d2-4f3d-b48b-9acb456e5cd7 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:00.363108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f1369ce7-37d2-4f3d-b48b-9acb456e5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:00.438258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 314/636] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:00.708771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87407-6639-4edf-b325-5248dfddb31e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:00.724267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:00.817239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87407-6639-4edf-b325-5248dfddb31e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:00.855159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b628ad5-f5a2-441a-a1f7-ba7e7fc95f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:00.855793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b628ad5-f5a2-441a-a1f7-ba7e7fc95f17 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:00.856075 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b628ad5-f5a2-441a-a1f7-ba7e7fc95f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:00.856351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b628ad5-f5a2-441a-a1f7-ba7e7fc95f17 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:00.856966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b628ad5-f5a2-441a-a1f7-ba7e7fc95f17 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:00.858338 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b628ad5-f5a2-441a-a1f7-ba7e7fc95f17 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-1b628ad5-f5a2-441a-a1f7-ba7e7fc95f17 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:00.868249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:00.869328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:00.870154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 323/637] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:22:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:00.875526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1369ce7-37d2-4f3d-b48b-9acb456e5cd7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:00.924114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:00.987449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1369ce7-37d2-4f3d-b48b-9acb456e5cd7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:01.005997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebbfb3-6e2b-453e-9032-befa255940e5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.006293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebbfb3-6e2b-453e-9032-befa255940e5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.006560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebbfb3-6e2b-453e-9032-befa255940e5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.012689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 324/638] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:01.014259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4fc2-589e-4049-8e2b-d69772fce113 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.014555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4fc2-589e-4049-8e2b-d69772fce113 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.014909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4fc2-589e-4049-8e2b-d69772fce113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.026865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0796f0-4fc2-42f7-a778-70669a449fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:01.027734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0796f0-4fc2-42f7-a778-70669a449fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.028240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0796f0-4fc2-42f7-a778-70669a449fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.028736 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0796f0-4fc2-42f7-a778-70669a449fd1 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.030052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0796f0-4fc2-42f7-a778-70669a449fd1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:01.030825 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0796f0-4fc2-42f7-a778-70669a449fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:01.032360 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0796f0-4fc2-42f7-a778-70669a449fd1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:01.034694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-be3c4fc2-589e-4049-8e2b-d69772fce113 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:01.035978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-be3c4fc2-589e-4049-8e2b-d69772fce113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:01.038112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 315/639] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:22:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:01.045224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0796f0-4fc2-42f7-a778-70669a449fd1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:01.112637 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 325/640] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:01.159762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0796f0-4fc2-42f7-a778-70669a449fd1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:01.184825 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:01.196114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbf44c-0fb3-41d9-b86c-bf454357b999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:01.197014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbf44c-0fb3-41d9-b86c-bf454357b999 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.197477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbf44c-0fb3-41d9-b86c-bf454357b999 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.198056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbf44c-0fb3-41d9-b86c-bf454357b999 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.198858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbf44c-0fb3-41d9-b86c-bf454357b999 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:01.199341 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbf44c-0fb3-41d9-b86c-bf454357b999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:01.200982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbf44c-0fb3-41d9-b86c-bf454357b999 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:01.206016 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 316/641] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:22:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:01.380742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c4fc2-589e-4049-8e2b-d69772fce113 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:01.390372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:01.430369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85068e-38a8-4474-a810-e1d061ac13a1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.430719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85068e-38a8-4474-a810-e1d061ac13a1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.430926 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85068e-38a8-4474-a810-e1d061ac13a1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.432402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 317/642] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:01.437854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b270e-3fac-4ee5-b269-07af97fa319f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.438143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b270e-3fac-4ee5-b269-07af97fa319f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.438428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b270e-3fac-4ee5-b269-07af97fa319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.457731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c97b270e-3fac-4ee5-b269-07af97fa319f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:01.459026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c97b270e-3fac-4ee5-b269-07af97fa319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:01.506150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c4fc2-589e-4049-8e2b-d69772fce113 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:01.538225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 318/643] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:01.546292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa259d-4ec5-490b-9e24-7194a4b73a6a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.546693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa259d-4ec5-490b-9e24-7194a4b73a6a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.546977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa259d-4ec5-490b-9e24-7194a4b73a6a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.547710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b086-4c92-44b6-9023-a7edce3e7a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:01.548337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b086-4c92-44b6-9023-a7edce3e7a72 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.548625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 319/644] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:01.552704 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b086-4c92-44b6-9023-a7edce3e7a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.552991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b086-4c92-44b6-9023-a7edce3e7a72 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.553589 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458b086-4c92-44b6-9023-a7edce3e7a72 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:01.553694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450cf24-38c2-4e81-8960-2627a15d267c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.553911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450cf24-38c2-4e81-8960-2627a15d267c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.554826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450cf24-38c2-4e81-8960-2627a15d267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.555523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458b086-4c92-44b6-9023-a7edce3e7a72 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8458b086-4c92-44b6-9023-a7edce3e7a72 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:01.564873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:01.565891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 03:22:01.567104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:01.570924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 326/645] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:22:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:01.572116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b086-4c92-44b6-9023-a7edce3e7a72 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:01.576722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a450cf24-38c2-4e81-8960-2627a15d267c None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:01.577925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a450cf24-38c2-4e81-8960-2627a15d267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:01.653868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:01.670215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 320/646] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:01.690152 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b086-4c92-44b6-9023-a7edce3e7a72 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:01.727388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928d824-311f-49c6-8417-dec945cbfb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:01.728052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d824-311f-49c6-8417-dec945cbfb0c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.728338 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d824-311f-49c6-8417-dec945cbfb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.728640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d824-311f-49c6-8417-dec945cbfb0c None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.729275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928d824-311f-49c6-8417-dec945cbfb0c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:01.729643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928d824-311f-49c6-8417-dec945cbfb0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:01.731022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928d824-311f-49c6-8417-dec945cbfb0c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:01.736056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 327/647] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:22:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:01.742850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450cf24-38c2-4e81-8960-2627a15d267c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:01.771010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:01.824941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928d824-311f-49c6-8417-dec945cbfb0c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:01.855842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450cf24-38c2-4e81-8960-2627a15d267c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:01.904312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3f45c-ab08-428d-be01-20158c96d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:01.905680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3f45c-ab08-428d-be01-20158c96d838 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.906141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3f45c-ab08-428d-be01-20158c96d838 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.906588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3f45c-ab08-428d-be01-20158c96d838 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.907453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3f45c-ab08-428d-be01-20158c96d838 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:01.907943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3f45c-ab08-428d-be01-20158c96d838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:01.909492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3f45c-ab08-428d-be01-20158c96d838 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:01.916852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 321/648] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:22:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:01.937172 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928d824-311f-49c6-8417-dec945cbfb0c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:01.942226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3f45c-ab08-428d-be01-20158c96d838 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:01.977175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998e7a-71bc-4089-bf15-366140067182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:01.977810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998e7a-71bc-4089-bf15-366140067182 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:01.978227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998e7a-71bc-4089-bf15-366140067182 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:01.978344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998e7a-71bc-4089-bf15-366140067182 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:01.979021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4998e7a-71bc-4089-bf15-366140067182 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:01.980551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4998e7a-71bc-4089-bf15-366140067182 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:01.984423 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:02.000954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 328/649] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:22:01 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:22:02.069340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:02.082205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3f45c-ab08-428d-be01-20158c96d838 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:02.130702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63105349-6a45-477e-bb3a-01931ca0a85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:02.131358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63105349-6a45-477e-bb3a-01931ca0a85c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:02.131636 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63105349-6a45-477e-bb3a-01931ca0a85c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:02.131904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63105349-6a45-477e-bb3a-01931ca0a85c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:02.144727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63105349-6a45-477e-bb3a-01931ca0a85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-63105349-6a45-477e-bb3a-01931ca0a85c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:22:02.149974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:02.150965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:02.152037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 322/650] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Nov 2 03:22:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:02.157432 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998e7a-71bc-4089-bf15-366140067182 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:02.274765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998e7a-71bc-4089-bf15-366140067182 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:02.310675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6d1eb-6783-457f-942f-9180b76fa5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:02.311283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6d1eb-6783-457f-942f-9180b76fa5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:02.311563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6d1eb-6783-457f-942f-9180b76fa5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:02.311832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6d1eb-6783-457f-942f-9180b76fa5c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:02.312530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6d1eb-6783-457f-942f-9180b76fa5c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:02.312835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6d1eb-6783-457f-942f-9180b76fa5c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:02.314200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6d1eb-6783-457f-942f-9180b76fa5c9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:02.323889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 329/651] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Nov 2 03:22:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:02.329360 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63105349-6a45-477e-bb3a-01931ca0a85c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:02.435312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63105349-6a45-477e-bb3a-01931ca0a85c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:02.472813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b8163-df5c-4ecd-a36c-7ff1a72ba42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:02.473806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b8163-df5c-4ecd-a36c-7ff1a72ba42f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:02.474288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b8163-df5c-4ecd-a36c-7ff1a72ba42f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:02.474753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b8163-df5c-4ecd-a36c-7ff1a72ba42f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:02.485951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b8163-df5c-4ecd-a36c-7ff1a72ba42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:02.487638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b8163-df5c-4ecd-a36c-7ff1a72ba42f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:02.495698 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-260b8163-df5c-4ecd-a36c-7ff1a72ba42f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:22:02.504357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:02.505303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:22:02.506154 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:22:02.506154 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:02.506154 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:02.508255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 323/652] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:02.514026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6d1eb-6783-457f-942f-9180b76fa5c9 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:02.573412 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:02.622422 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6d1eb-6783-457f-942f-9180b76fa5c9 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:02.661802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d28eb-12eb-4536-aaa0-198dece0eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:02.662421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d28eb-12eb-4536-aaa0-198dece0eb1d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:02.662702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d28eb-12eb-4536-aaa0-198dece0eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:02.662976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d28eb-12eb-4536-aaa0-198dece0eb1d None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:02.663908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d28eb-12eb-4536-aaa0-198dece0eb1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:02.664220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d28eb-12eb-4536-aaa0-198dece0eb1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:02.665633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d28eb-12eb-4536-aaa0-198dece0eb1d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:02.678073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 330/653] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:02.683712 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b8163-df5c-4ecd-a36c-7ff1a72ba42f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:02.793506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b8163-df5c-4ecd-a36c-7ff1a72ba42f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:02.827864 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c7993-1ffd-4f04-8489-82b40e329efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:02.828576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c7993-1ffd-4f04-8489-82b40e329efa None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:02.828854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c7993-1ffd-4f04-8489-82b40e329efa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:02.829118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c7993-1ffd-4f04-8489-82b40e329efa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:02.836940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c7993-1ffd-4f04-8489-82b40e329efa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:02.838380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c7993-1ffd-4f04-8489-82b40e329efa None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-351c7993-1ffd-4f04-8489-82b40e329efa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:22:02.850166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:02.851853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:02.852831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 324/654] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Nov 2 03:22:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:02.857407 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d28eb-12eb-4536-aaa0-198dece0eb1d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:02.972032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d28eb-12eb-4536-aaa0-198dece0eb1d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:02.990231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:03.009791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a395a1-9df2-4506-8a5b-33517968d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:03.010390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a395a1-9df2-4506-8a5b-33517968d604 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:03.010674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a395a1-9df2-4506-8a5b-33517968d604 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:03.011001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a395a1-9df2-4506-8a5b-33517968d604 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:03.011726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a395a1-9df2-4506-8a5b-33517968d604 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:03.012026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a395a1-9df2-4506-8a5b-33517968d604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:03.013469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a395a1-9df2-4506-8a5b-33517968d604 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:03.031724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 331/655] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Nov 2 03:22:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:03.037256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c7993-1ffd-4f04-8489-82b40e329efa None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:03.107510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:03.151750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c7993-1ffd-4f04-8489-82b40e329efa None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:03.185833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c2912-492b-4356-9c23-ae3995b3d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:03.186512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c2912-492b-4356-9c23-ae3995b3d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:03.186786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c2912-492b-4356-9c23-ae3995b3d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:03.187053 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c2912-492b-4356-9c23-ae3995b3d1a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:03.198444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c2912-492b-4356-9c23-ae3995b3d1a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:03.199892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c2912-492b-4356-9c23-ae3995b3d1a1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-696c2912-492b-4356-9c23-ae3995b3d1a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:22:03.214978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:03.215952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:22:03.216862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:22:03.216862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:03.216862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:03.216862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 325/656] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:03.225860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a395a1-9df2-4506-8a5b-33517968d604 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:03.330636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a395a1-9df2-4506-8a5b-33517968d604 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:03.367261 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3605de2-8fa3-4ef3-9cc0-53a91de711f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:03.367926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605de2-8fa3-4ef3-9cc0-53a91de711f0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:03.368203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605de2-8fa3-4ef3-9cc0-53a91de711f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:03.368487 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605de2-8fa3-4ef3-9cc0-53a91de711f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:03.369155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605de2-8fa3-4ef3-9cc0-53a91de711f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:03.369461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605de2-8fa3-4ef3-9cc0-53a91de711f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:03.370873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605de2-8fa3-4ef3-9cc0-53a91de711f0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:03.384765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 332/657] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:03.390504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c2912-492b-4356-9c23-ae3995b3d1a1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:03.497710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f312-674d-4d98-b435-d1f3e8d56e98 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:03.498002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f312-674d-4d98-b435-d1f3e8d56e98 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:03.498279 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f312-674d-4d98-b435-d1f3e8d56e98 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:03.499786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 333/658] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:03.502464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c2912-492b-4356-9c23-ae3995b3d1a1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:03.509235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c61b10-7f41-4589-892d-673650e839b6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:03.509802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c61b10-7f41-4589-892d-673650e839b6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:03.510274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c61b10-7f41-4589-892d-673650e839b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:03.519569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:03.537892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d6c61b10-7f41-4589-892d-673650e839b6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:03.540499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d6c61b10-7f41-4589-892d-673650e839b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:03.543065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc2e0-40b7-4f33-92c6-af344587d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:03.543699 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc2e0-40b7-4f33-92c6-af344587d54f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:03.544001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc2e0-40b7-4f33-92c6-af344587d54f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:03.544249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc2e0-40b7-4f33-92c6-af344587d54f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:03.551310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cc2e0-40b7-4f33-92c6-af344587d54f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:03.552772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cc2e0-40b7-4f33-92c6-af344587d54f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c32cc2e0-40b7-4f33-92c6-af344587d54f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:22:03.564229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:03.565164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:03.566035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:22:03.566035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:22:03.566035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:22:03.566035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:22:03.566035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:22:03.566035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:22:03.566035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:22:03.566035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:03.570594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 326/659] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:22:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:03.571767 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc2e0-40b7-4f33-92c6-af344587d54f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:03.576838 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:03.644672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 334/660] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:03 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:03.679276 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc2e0-40b7-4f33-92c6-af344587d54f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:03.715961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c903d-05e7-4002-aa84-c458f06b9c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:03.716928 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c903d-05e7-4002-aa84-c458f06b9c59 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:03.717415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c903d-05e7-4002-aa84-c458f06b9c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:03.717859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c903d-05e7-4002-aa84-c458f06b9c59 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:03.718716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c903d-05e7-4002-aa84-c458f06b9c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:03.719310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c903d-05e7-4002-aa84-c458f06b9c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:03.720911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c903d-05e7-4002-aa84-c458f06b9c59 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:03.734989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 327/661] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:22:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:03.741919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c61b10-7f41-4589-892d-673650e839b6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:03.846968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c61b10-7f41-4589-892d-673650e839b6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:03.883904 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64d59f-f50a-499a-ac6b-505cbf36ff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:03.884595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64d59f-f50a-499a-ac6b-505cbf36ff88 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:03.884875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64d59f-f50a-499a-ac6b-505cbf36ff88 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:03.885145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64d59f-f50a-499a-ac6b-505cbf36ff88 None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/8937e32b919e4f5882ec84250147cbcd/roles/f0fe71340dad4d7a9ce41085edc42c99` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:03.887316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64d59f-f50a-499a-ac6b-505cbf36ff88 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=8937e32b919e4f5882ec84250147cbcd, role_id=f0fe71340dad4d7a9ce41085edc42c99)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:03.888772 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64d59f-f50a-499a-ac6b-505cbf36ff88 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:03.905636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 335/662] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:22:03 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/8937e32b919e4f5882ec84250147cbcd/roles/f0fe71340dad4d7a9ce41085edc42c99 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:22:03.937251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c903d-05e7-4002-aa84-c458f06b9c59 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:03.973233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:04.056494 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c903d-05e7-4002-aa84-c458f06b9c59 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:04.092296 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c741cf-2b4d-421e-81bd-298ec120b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:04.092960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c741cf-2b4d-421e-81bd-298ec120b63c None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:04.093238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c741cf-2b4d-421e-81bd-298ec120b63c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:04.093508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c741cf-2b4d-421e-81bd-298ec120b63c None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:04.094176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c741cf-2b4d-421e-81bd-298ec120b63c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:04.095572 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c741cf-2b4d-421e-81bd-298ec120b63c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:04.114470 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 328/663] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:22:03 2022] POST /identity/v3/services => generated 241 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:04.224664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904fcb-1f73-483c-a502-387a3dffbd33 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:04.225029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904fcb-1f73-483c-a502-387a3dffbd33 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:04.225232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904fcb-1f73-483c-a502-387a3dffbd33 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:04.227514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 336/664] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:04.233132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d411-ec10-4691-a2e9-98d836fb4276 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:04.233419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d411-ec10-4691-a2e9-98d836fb4276 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:04.233694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699d411-ec10-4691-a2e9-98d836fb4276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:04.253424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5699d411-ec10-4691-a2e9-98d836fb4276 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:04.254634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5699d411-ec10-4691-a2e9-98d836fb4276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:04.338433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 329/665] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:04 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:04.473874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017833a8-e54b-4a8d-aaf4-8e5302e9c41d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:04.474197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017833a8-e54b-4a8d-aaf4-8e5302e9c41d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:04.474423 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017833a8-e54b-4a8d-aaf4-8e5302e9c41d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:04.476158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 337/666] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:04.481577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efd7e1-5409-403c-98d7-43677a5847d4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:04.482177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efd7e1-5409-403c-98d7-43677a5847d4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:04.482721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efd7e1-5409-403c-98d7-43677a5847d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:04.502496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-73efd7e1-5409-403c-98d7-43677a5847d4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:04.504053 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-73efd7e1-5409-403c-98d7-43677a5847d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:04.516564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:04.579299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 330/667] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:04 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:04.610789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017833a8-e54b-4a8d-aaf4-8e5302e9c41d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:04.642420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:04.726542 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017833a8-e54b-4a8d-aaf4-8e5302e9c41d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:04.762806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bab8cb-657c-4a6a-8f9c-b4e9035a9e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:04.763699 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bab8cb-657c-4a6a-8f9c-b4e9035a9e72 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:04.764178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bab8cb-657c-4a6a-8f9c-b4e9035a9e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:04.764650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bab8cb-657c-4a6a-8f9c-b4e9035a9e72 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:04.765525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bab8cb-657c-4a6a-8f9c-b4e9035a9e72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:04.767043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bab8cb-657c-4a6a-8f9c-b4e9035a9e72 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:04.784991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 338/668] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:22:04 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:04.862033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efd7e1-5409-403c-98d7-43677a5847d4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:04.977116 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efd7e1-5409-403c-98d7-43677a5847d4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:05.019087 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2fbe1-d81b-4fb0-b151-e4fd96cbdbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:05.019722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2fbe1-d81b-4fb0-b151-e4fd96cbdbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:05.020001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2fbe1-d81b-4fb0-b151-e4fd96cbdbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:05.020271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2fbe1-d81b-4fb0-b151-e4fd96cbdbe7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:05.020878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2fbe1-d81b-4fb0-b151-e4fd96cbdbe7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:05.022235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2fbe1-d81b-4fb0-b151-e4fd96cbdbe7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-67a2fbe1-d81b-4fb0-b151-e4fd96cbdbe7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:05.031321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:05.032307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:05.033266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 331/669] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Nov 2 03:22:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:05.040696 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bab8cb-657c-4a6a-8f9c-b4e9035a9e72 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:05.133977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:05.152937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bab8cb-657c-4a6a-8f9c-b4e9035a9e72 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:05.187603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da27d0-22b2-4571-b4e8-3fe6c5d1cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:05.188438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da27d0-22b2-4571-b4e8-3fe6c5d1cbbb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:05.188902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da27d0-22b2-4571-b4e8-3fe6c5d1cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:05.189368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da27d0-22b2-4571-b4e8-3fe6c5d1cbbb None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:05.190154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da27d0-22b2-4571-b4e8-3fe6c5d1cbbb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:05.190591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da27d0-22b2-4571-b4e8-3fe6c5d1cbbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:05.192078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da27d0-22b2-4571-b4e8-3fe6c5d1cbbb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:05.197957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 339/670] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:22:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:05.203664 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2fbe1-d81b-4fb0-b151-e4fd96cbdbe7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:05.213885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:05.309218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2fbe1-d81b-4fb0-b151-e4fd96cbdbe7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:05.344836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d976-0541-43e0-846e-0478ec364a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:05.345684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d976-0541-43e0-846e-0478ec364a1c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:05.346105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d976-0541-43e0-846e-0478ec364a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:05.346541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d976-0541-43e0-846e-0478ec364a1c None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:05.347384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d976-0541-43e0-846e-0478ec364a1c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:05.347827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d976-0541-43e0-846e-0478ec364a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:05.349340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d976-0541-43e0-846e-0478ec364a1c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:05.354790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 332/671] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:22:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:05.360658 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da27d0-22b2-4571-b4e8-3fe6c5d1cbbb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:05.467357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da27d0-22b2-4571-b4e8-3fe6c5d1cbbb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:05.503389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eb5d6-60b7-4df6-88fc-abf87bda32bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:05.504259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eb5d6-60b7-4df6-88fc-abf87bda32bb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:05.504709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eb5d6-60b7-4df6-88fc-abf87bda32bb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:05.505194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eb5d6-60b7-4df6-88fc-abf87bda32bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:05.506028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eb5d6-60b7-4df6-88fc-abf87bda32bb None admin] RBAC: Adding query filter params (interface=public, service_id=b22a1812535d4952930221d9255e25bd, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:05.506477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eb5d6-60b7-4df6-88fc-abf87bda32bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:05.508591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eb5d6-60b7-4df6-88fc-abf87bda32bb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:05.516879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 340/672] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Nov 2 03:22:05 2022] GET /identity/v3/endpoints?service_id=b22a1812535d4952930221d9255e25bd&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:05.522720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d976-0541-43e0-846e-0478ec364a1c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:05.596331 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:05.629191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d976-0541-43e0-846e-0478ec364a1c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:05.663859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01284208-b08e-4ef2-92ac-f4a4f6d79467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:05.664608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01284208-b08e-4ef2-92ac-f4a4f6d79467 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:05.664890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01284208-b08e-4ef2-92ac-f4a4f6d79467 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:05.665208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01284208-b08e-4ef2-92ac-f4a4f6d79467 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:05.665803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01284208-b08e-4ef2-92ac-f4a4f6d79467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:05.667210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01284208-b08e-4ef2-92ac-f4a4f6d79467 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:05.673455 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 333/673] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Nov 2 03:22:05 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:22:06.269583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f75f68-0e3b-41e3-98eb-bd4f8ee200a5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:06.270643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f75f68-0e3b-41e3-98eb-bd4f8ee200a5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:06.271136 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f75f68-0e3b-41e3-98eb-bd4f8ee200a5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:06.273928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 341/674] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:06.280046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715793c-e46c-49bb-86e8-2958644a194c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:06.281066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715793c-e46c-49bb-86e8-2958644a194c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:06.281555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715793c-e46c-49bb-86e8-2958644a194c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:06.306033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7715793c-e46c-49bb-86e8-2958644a194c None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:06.307165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7715793c-e46c-49bb-86e8-2958644a194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:06.376262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 334/675] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:06.398411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb454-c555-47c7-aa11-70b6abb905bd None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:06.399029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb454-c555-47c7-aa11-70b6abb905bd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:06.399505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb454-c555-47c7-aa11-70b6abb905bd None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:06.401318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 342/676] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:06.406431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a56c9-f342-41ed-bac0-cf6349914546 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:06.406800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a56c9-f342-41ed-bac0-cf6349914546 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:06.407007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a56c9-f342-41ed-bac0-cf6349914546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:06.426011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9a6a56c9-f342-41ed-bac0-cf6349914546 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:06.427205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9a6a56c9-f342-41ed-bac0-cf6349914546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:06.490125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:06.499713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 335/677] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:06.661321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb454-c555-47c7-aa11-70b6abb905bd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:06.678141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:06.778777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb454-c555-47c7-aa11-70b6abb905bd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:06.782876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a56c9-f342-41ed-bac0-cf6349914546 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:06.823472 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cab1f-c5ba-4da4-b73d-654fab7bb2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:06.824118 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cab1f-c5ba-4da4-b73d-654fab7bb2da None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:06.824396 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cab1f-c5ba-4da4-b73d-654fab7bb2da None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:06.824699 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cab1f-c5ba-4da4-b73d-654fab7bb2da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:06.836833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cab1f-c5ba-4da4-b73d-654fab7bb2da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-743cab1f-c5ba-4da4-b73d-654fab7bb2da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:22:06.843276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:06.844197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 03:22:06.845366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:06.848881 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 343/678] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Nov 2 03:22:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:06.857707 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cab1f-c5ba-4da4-b73d-654fab7bb2da None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:06.899856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a56c9-f342-41ed-bac0-cf6349914546 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:06.940109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa67fb-1191-41a7-9a1b-042edbc04999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:06.940806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:06.941466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa67fb-1191-41a7-9a1b-042edbc04999 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:06.941931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa67fb-1191-41a7-9a1b-042edbc04999 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:06.942388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa67fb-1191-41a7-9a1b-042edbc04999 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:06.943197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa67fb-1191-41a7-9a1b-042edbc04999 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:06.945209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa67fb-1191-41a7-9a1b-042edbc04999 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fefa67fb-1191-41a7-9a1b-042edbc04999 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:06.958772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:06.960923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:06.962403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:06.966808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 336/679] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:22:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:06.968230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa67fb-1191-41a7-9a1b-042edbc04999 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:06.999539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cab1f-c5ba-4da4-b73d-654fab7bb2da None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:07.045090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:07.055275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2ff89-d109-4c83-a459-311ee4c3df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:07.055899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2ff89-d109-4c83-a459-311ee4c3df75 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.056187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2ff89-d109-4c83-a459-311ee4c3df75 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.056494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2ff89-d109-4c83-a459-311ee4c3df75 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.057168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2ff89-d109-4c83-a459-311ee4c3df75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:07.057563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2ff89-d109-4c83-a459-311ee4c3df75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:07.058997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2ff89-d109-4c83-a459-311ee4c3df75 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:07.073146 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 344/680] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Nov 2 03:22:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:07.074275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2ff89-d109-4c83-a459-311ee4c3df75 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:07.098659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa67fb-1191-41a7-9a1b-042edbc04999 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:07.136228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8d456-f0a4-4ae6-b43c-6801f4459d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:07.136881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8d456-f0a4-4ae6-b43c-6801f4459d69 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.137159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8d456-f0a4-4ae6-b43c-6801f4459d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.137456 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8d456-f0a4-4ae6-b43c-6801f4459d69 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.138395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8d456-f0a4-4ae6-b43c-6801f4459d69 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:07.138715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8d456-f0a4-4ae6-b43c-6801f4459d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:07.140034 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8d456-f0a4-4ae6-b43c-6801f4459d69 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:07.144852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 337/681] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:22:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:07.145970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14913-904e-4757-a455-0e845e283b95 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.146246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14913-904e-4757-a455-0e845e283b95 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.146514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14913-904e-4757-a455-0e845e283b95 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.148489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 338/682] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:07.153543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e14913-904e-4757-a455-0e845e283b95 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:07.192778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2ff89-d109-4c83-a459-311ee4c3df75 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:07.228755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd384254-9304-4061-bfb4-ae3d16b8a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:07.229366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384254-9304-4061-bfb4-ae3d16b8a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.229649 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384254-9304-4061-bfb4-ae3d16b8a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.229919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384254-9304-4061-bfb4-ae3d16b8a3a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.231815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:07.244909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd384254-9304-4061-bfb4-ae3d16b8a3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:07.246551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd384254-9304-4061-bfb4-ae3d16b8a3a2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-fd384254-9304-4061-bfb4-ae3d16b8a3a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:22:07.262076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:07.263031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:22:07.263923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:22:07.263923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:07.263923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:07.263923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 345/683] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:07.264715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debcaf-e6b8-4782-a47f-92b90aeaf505 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.264715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debcaf-e6b8-4782-a47f-92b90aeaf505 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.264890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debcaf-e6b8-4782-a47f-92b90aeaf505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.273194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e14913-904e-4757-a455-0e845e283b95 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:07.285396 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-72debcaf-e6b8-4782-a47f-92b90aeaf505 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:07.286584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-72debcaf-e6b8-4782-a47f-92b90aeaf505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:07.296491 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:07.309064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cae9a4-d14c-4ae3-93f1-6736095dd1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:07.309734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cae9a4-d14c-4ae3-93f1-6736095dd1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.310011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cae9a4-d14c-4ae3-93f1-6736095dd1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.310279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cae9a4-d14c-4ae3-93f1-6736095dd1f0 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.310963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cae9a4-d14c-4ae3-93f1-6736095dd1f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:07.311246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cae9a4-d14c-4ae3-93f1-6736095dd1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:07.312727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cae9a4-d14c-4ae3-93f1-6736095dd1f0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:07.323457 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 339/684] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:22:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:07.324315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cae9a4-d14c-4ae3-93f1-6736095dd1f0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:07.372146 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 346/685] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:07.372146 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72debcaf-e6b8-4782-a47f-92b90aeaf505 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:07.430118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cae9a4-d14c-4ae3-93f1-6736095dd1f0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:07.471307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efc0c3-ef18-430f-92de-321f20c0c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:07.472092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efc0c3-ef18-430f-92de-321f20c0c163 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.472470 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efc0c3-ef18-430f-92de-321f20c0c163 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.472825 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efc0c3-ef18-430f-92de-321f20c0c163 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.473546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efc0c3-ef18-430f-92de-321f20c0c163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:07.473909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efc0c3-ef18-430f-92de-321f20c0c163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:07.475329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efc0c3-ef18-430f-92de-321f20c0c163 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:07.493163 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 340/686] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:07.494143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efc0c3-ef18-430f-92de-321f20c0c163 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:07.500900 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72debcaf-e6b8-4782-a47f-92b90aeaf505 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:07.523676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:07.542386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba74f20-8d28-4d30-9024-9ed119550205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:07.543139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba74f20-8d28-4d30-9024-9ed119550205 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.543527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba74f20-8d28-4d30-9024-9ed119550205 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.543875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba74f20-8d28-4d30-9024-9ed119550205 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.544731 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba74f20-8d28-4d30-9024-9ed119550205 None admin] RBAC: Adding query filter params (interface=public, service_id=837e833e40bd4b1a8ea0851a66e26680, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:07.545263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba74f20-8d28-4d30-9024-9ed119550205 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:07.547921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba74f20-8d28-4d30-9024-9ed119550205 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:07.550802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:07.557488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 347/687] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Nov 2 03:22:07 2022] GET /identity/v3/endpoints?service_id=837e833e40bd4b1a8ea0851a66e26680&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:07.562919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba74f20-8d28-4d30-9024-9ed119550205 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:07.621046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efc0c3-ef18-430f-92de-321f20c0c163 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:07.661856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deba16-81c9-4731-9210-efec79f1c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:07.663013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deba16-81c9-4731-9210-efec79f1c97d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.664495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deba16-81c9-4731-9210-efec79f1c97d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.665192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deba16-81c9-4731-9210-efec79f1c97d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.666929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba74f20-8d28-4d30-9024-9ed119550205 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:07.673290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deba16-81c9-4731-9210-efec79f1c97d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:07.675021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deba16-81c9-4731-9210-efec79f1c97d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-52deba16-81c9-4731-9210-efec79f1c97d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:22:07.688634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:07.689780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:07.690685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 341/688] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Nov 2 03:22:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:07.691248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deba16-81c9-4731-9210-efec79f1c97d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:07.706071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108a462-0787-4cf4-b1ea-818b5df3951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:07.706680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108a462-0787-4cf4-b1ea-818b5df3951b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.706963 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108a462-0787-4cf4-b1ea-818b5df3951b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.707445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108a462-0787-4cf4-b1ea-818b5df3951b None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.707838 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108a462-0787-4cf4-b1ea-818b5df3951b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:07.709258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108a462-0787-4cf4-b1ea-818b5df3951b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:07.720624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 348/689] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Nov 2 03:22:07 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:22:07.720624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108a462-0787-4cf4-b1ea-818b5df3951b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:07.777832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:07.821999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deba16-81c9-4731-9210-efec79f1c97d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:07.832001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:07.853188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108a462-0787-4cf4-b1ea-818b5df3951b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:07.870761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ce6a3-075e-4929-9e2d-7a330c865169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:07.871695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ce6a3-075e-4929-9e2d-7a330c865169 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.872125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ce6a3-075e-4929-9e2d-7a330c865169 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.872592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ce6a3-075e-4929-9e2d-7a330c865169 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.873362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ce6a3-075e-4929-9e2d-7a330c865169 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:07.874944 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ce6a3-075e-4929-9e2d-7a330c865169 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-261ce6a3-075e-4929-9e2d-7a330c865169 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:07.885202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:07.886355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 03:22:07.887237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:07.889395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 342/690] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:22:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:07.895667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ce6a3-075e-4929-9e2d-7a330c865169 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:07.903740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17727449-397e-487c-8bf1-32bb945d6674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:07.904402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17727449-397e-487c-8bf1-32bb945d6674 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:07.904723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17727449-397e-487c-8bf1-32bb945d6674 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:07.905001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17727449-397e-487c-8bf1-32bb945d6674 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:07.906203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17727449-397e-487c-8bf1-32bb945d6674 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:07.906757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17727449-397e-487c-8bf1-32bb945d6674 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:07.908714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17727449-397e-487c-8bf1-32bb945d6674 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:07.928339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 349/691] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Nov 2 03:22:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:07.937403 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17727449-397e-487c-8bf1-32bb945d6674 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:08.017236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ce6a3-075e-4929-9e2d-7a330c865169 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:08.052841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17727449-397e-487c-8bf1-32bb945d6674 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:08.054807 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:08.059331 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d91326-b2a5-494f-9485-bf2bf71f2d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:08.059946 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91326-b2a5-494f-9485-bf2bf71f2d59 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.060224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91326-b2a5-494f-9485-bf2bf71f2d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.060591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91326-b2a5-494f-9485-bf2bf71f2d59 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.061222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d91326-b2a5-494f-9485-bf2bf71f2d59 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:08.061978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d91326-b2a5-494f-9485-bf2bf71f2d59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:08.063349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d91326-b2a5-494f-9485-bf2bf71f2d59 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:08.072655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 343/692] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:22:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:08.074189 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ace1a-b93b-44aa-a6fa-fd70f61d4a24 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.074477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ace1a-b93b-44aa-a6fa-fd70f61d4a24 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.074842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ace1a-b93b-44aa-a6fa-fd70f61d4a24 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.076078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 344/693] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:08.076804 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ace1a-b93b-44aa-a6fa-fd70f61d4a24 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:08.095343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55af775-4f53-4226-9617-cabfc7d0f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:08.095984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af775-4f53-4226-9617-cabfc7d0f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.096234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af775-4f53-4226-9617-cabfc7d0f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.096542 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af775-4f53-4226-9617-cabfc7d0f8d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.119263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:08.175648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55af775-4f53-4226-9617-cabfc7d0f8d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:08.177126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55af775-4f53-4226-9617-cabfc7d0f8d1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:08.189934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ace1a-b93b-44aa-a6fa-fd70f61d4a24 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:08.228050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5871696-3fe6-4637-a4e5-ad913948dfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:08.228765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5871696-3fe6-4637-a4e5-ad913948dfae None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.228969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5871696-3fe6-4637-a4e5-ad913948dfae None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.229242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5871696-3fe6-4637-a4e5-ad913948dfae None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.229869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5871696-3fe6-4637-a4e5-ad913948dfae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:08.230278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5871696-3fe6-4637-a4e5-ad913948dfae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:08.231520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5871696-3fe6-4637-a4e5-ad913948dfae None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:08.236794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 345/694] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:22:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:08.237731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d3580-2330-4991-a6f4-4a0a2f774754 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.238022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d3580-2330-4991-a6f4-4a0a2f774754 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.238312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d3580-2330-4991-a6f4-4a0a2f774754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.258614 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-663d3580-2330-4991-a6f4-4a0a2f774754 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:08.259803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-663d3580-2330-4991-a6f4-4a0a2f774754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:08.285987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 350/695] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:22:07 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 03:22:08.286835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55af775-4f53-4226-9617-cabfc7d0f8d1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:08.289780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:08.348565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 346/696] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:08.348565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d3580-2330-4991-a6f4-4a0a2f774754 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:08.369811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:08.426350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55af775-4f53-4226-9617-cabfc7d0f8d1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:08.449339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d3580-2330-4991-a6f4-4a0a2f774754 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:08.475994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b60f70-a0b0-472c-98f8-a20599368a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:08.477272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b60f70-a0b0-472c-98f8-a20599368a53 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.478177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b60f70-a0b0-472c-98f8-a20599368a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.478925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b60f70-a0b0-472c-98f8-a20599368a53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.480083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b60f70-a0b0-472c-98f8-a20599368a53 None admin] RBAC: Adding query filter params (interface=public, service_id=d9f1bbdec75448668b9037904a06a910, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:08.480999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b60f70-a0b0-472c-98f8-a20599368a53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:08.482979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b60f70-a0b0-472c-98f8-a20599368a53 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:08.485766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4be67-8382-4f6e-9fd4-8628ee16acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:08.486484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4be67-8382-4f6e-9fd4-8628ee16acc8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.486832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4be67-8382-4f6e-9fd4-8628ee16acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.487176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4be67-8382-4f6e-9fd4-8628ee16acc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.491011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 351/697] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Nov 2 03:22:08 2022] GET /identity/v3/endpoints?service_id=d9f1bbdec75448668b9037904a06a910&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:08.497851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b60f70-a0b0-472c-98f8-a20599368a53 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:08.504556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4be67-8382-4f6e-9fd4-8628ee16acc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:08.505992 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4be67-8382-4f6e-9fd4-8628ee16acc8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f6c4be67-8382-4f6e-9fd4-8628ee16acc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:22:08.522729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:08.523793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:22:08.524728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:22:08.524728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:08.524728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:08.529052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 347/698] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:08.530091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4be67-8382-4f6e-9fd4-8628ee16acc8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:08.588039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:08.618943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:08.633683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b60f70-a0b0-472c-98f8-a20599368a53 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:08.640582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4be67-8382-4f6e-9fd4-8628ee16acc8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:08.670430 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fbe25-9971-4a50-91b1-dd410e78596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:08.671041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fbe25-9971-4a50-91b1-dd410e78596e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.671320 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fbe25-9971-4a50-91b1-dd410e78596e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.671591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fbe25-9971-4a50-91b1-dd410e78596e None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.672194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fbe25-9971-4a50-91b1-dd410e78596e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:08.673623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fbe25-9971-4a50-91b1-dd410e78596e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:08.678268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6338b7c-a8d6-4421-88cd-0e5919c2c3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:08.679409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6338b7c-a8d6-4421-88cd-0e5919c2c3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.679688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6338b7c-a8d6-4421-88cd-0e5919c2c3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.679957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6338b7c-a8d6-4421-88cd-0e5919c2c3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.680727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 352/699] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Nov 2 03:22:08 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:22:08.680833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6338b7c-a8d6-4421-88cd-0e5919c2c3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:08.680999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6338b7c-a8d6-4421-88cd-0e5919c2c3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:08.682326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6338b7c-a8d6-4421-88cd-0e5919c2c3e1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:08.686097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fbe25-9971-4a50-91b1-dd410e78596e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:08.701281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 348/700] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:08.704004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6338b7c-a8d6-4421-88cd-0e5919c2c3e1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:08.832775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fbe25-9971-4a50-91b1-dd410e78596e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:08.837878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6338b7c-a8d6-4421-88cd-0e5919c2c3e1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:08.867178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:08.875652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b836da-68a2-472d-8db9-f4ebe8c11563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:08.876215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b836da-68a2-472d-8db9-f4ebe8c11563 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.876520 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b836da-68a2-472d-8db9-f4ebe8c11563 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.876790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b836da-68a2-472d-8db9-f4ebe8c11563 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.877375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b836da-68a2-472d-8db9-f4ebe8c11563 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:08.878790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b836da-68a2-472d-8db9-f4ebe8c11563 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d7b836da-68a2-472d-8db9-f4ebe8c11563 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:08.889037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:08.889988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:08.890871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 353/701] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Nov 2 03:22:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:08.893058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dfcd7-8bfd-47e4-94e9-7833aa14852a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:08.893900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dfcd7-8bfd-47e4-94e9-7833aa14852a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:08.894178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dfcd7-8bfd-47e4-94e9-7833aa14852a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:08.894448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dfcd7-8bfd-47e4-94e9-7833aa14852a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:08.896242 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b836da-68a2-472d-8db9-f4ebe8c11563 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:08.902593 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dfcd7-8bfd-47e4-94e9-7833aa14852a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:08.904027 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dfcd7-8bfd-47e4-94e9-7833aa14852a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:08.910201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-264dfcd7-8bfd-47e4-94e9-7833aa14852a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:22:08.917701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:08.918583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:08.919463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:22:08.919463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:22:08.919463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:22:08.919463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:22:08.919463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:22:08.919463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:22:08.919463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:22:08.919463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:08.919463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 349/702] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:22:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:08.924562 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dfcd7-8bfd-47e4-94e9-7833aa14852a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:09.028532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b836da-68a2-472d-8db9-f4ebe8c11563 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:09.037200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dfcd7-8bfd-47e4-94e9-7833aa14852a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:09.075118 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e555a-d56c-497d-80e5-80e063984353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:09.075976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e555a-d56c-497d-80e5-80e063984353 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:09.076402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e555a-d56c-497d-80e5-80e063984353 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:09.076830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25954f-aae7-4198-8672-7643602ef7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:09.077009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e555a-d56c-497d-80e5-80e063984353 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:09.077584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25954f-aae7-4198-8672-7643602ef7ba None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:09.077935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25954f-aae7-4198-8672-7643602ef7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:09.078074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e555a-d56c-497d-80e5-80e063984353 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:09.078339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25954f-aae7-4198-8672-7643602ef7ba None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:09.078639 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e555a-d56c-497d-80e5-80e063984353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:09.079168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25954f-aae7-4198-8672-7643602ef7ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:09.079547 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25954f-aae7-4198-8672-7643602ef7ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:09.080566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e555a-d56c-497d-80e5-80e063984353 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:09.081128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25954f-aae7-4198-8672-7643602ef7ba None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:09.087238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 354/703] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:22:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:09.095333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e555a-d56c-497d-80e5-80e063984353 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:09.096511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 350/704] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:22:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:09.104507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25954f-aae7-4198-8672-7643602ef7ba None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:09.165082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:09.189963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:09.215171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e555a-d56c-497d-80e5-80e063984353 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:09.241112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25954f-aae7-4198-8672-7643602ef7ba None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:09.258904 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee26e78-ea34-4faf-9dc6-245628b349e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:09.259647 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee26e78-ea34-4faf-9dc6-245628b349e4 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:09.260031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee26e78-ea34-4faf-9dc6-245628b349e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:09.260408 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee26e78-ea34-4faf-9dc6-245628b349e4 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:09.261189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee26e78-ea34-4faf-9dc6-245628b349e4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:09.261594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee26e78-ea34-4faf-9dc6-245628b349e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:09.263084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee26e78-ea34-4faf-9dc6-245628b349e4 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:09.268605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 355/705] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:22:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:09.274559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee26e78-ea34-4faf-9dc6-245628b349e4 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:09.291240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b66fc-c413-46d0-8080-60c1a360b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:09.291995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b66fc-c413-46d0-8080-60c1a360b28a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:09.292364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b66fc-c413-46d0-8080-60c1a360b28a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:09.292758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b66fc-c413-46d0-8080-60c1a360b28a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:09.293610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b66fc-c413-46d0-8080-60c1a360b28a None admin] RBAC: Adding query filter params (role.id=f0fe71340dad4d7a9ce41085edc42c99, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=8937e32b919e4f5882ec84250147cbcd) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:09.294009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b66fc-c413-46d0-8080-60c1a360b28a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:09.295727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b66fc-c413-46d0-8080-60c1a360b28a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:09.302198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 351/706] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:22:09 2022] GET /identity/v3/role_assignments?user.id=8937e32b919e4f5882ec84250147cbcd&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=f0fe71340dad4d7a9ce41085edc42c99 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:09.387680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee26e78-ea34-4faf-9dc6-245628b349e4 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:09.412759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:09.426107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2337d9e-3281-4650-a675-783b5c1fb641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:09.426647 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337d9e-3281-4650-a675-783b5c1fb641 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:09.426970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337d9e-3281-4650-a675-783b5c1fb641 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:09.427246 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337d9e-3281-4650-a675-783b5c1fb641 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:09.427923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2337d9e-3281-4650-a675-783b5c1fb641 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:09.429710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2337d9e-3281-4650-a675-783b5c1fb641 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:09.461028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 356/707] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:22:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:22:09.989192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddd6cb-676f-4f6d-b0f4-732b1075c7a0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:09.989711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddd6cb-676f-4f6d-b0f4-732b1075c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:09.989711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddd6cb-676f-4f6d-b0f4-732b1075c7a0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:09.992013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 352/708] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:09.997528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573993-38c1-4792-8a55-c57c4e2c5d5e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:09.997814 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573993-38c1-4792-8a55-c57c4e2c5d5e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:09.998089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573993-38c1-4792-8a55-c57c4e2c5d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:10.016713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e4573993-38c1-4792-8a55-c57c4e2c5d5e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:10.017901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e4573993-38c1-4792-8a55-c57c4e2c5d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:10.099743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 357/709] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:10.370910 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddd6cb-676f-4f6d-b0f4-732b1075c7a0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:10.480995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddd6cb-676f-4f6d-b0f4-732b1075c7a0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:10.504827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:10.516025 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fc41f-477a-4723-84f1-ce43b97c15e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:10.516695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fc41f-477a-4723-84f1-ce43b97c15e0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:10.516974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fc41f-477a-4723-84f1-ce43b97c15e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:10.517242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fc41f-477a-4723-84f1-ce43b97c15e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:10.517819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fc41f-477a-4723-84f1-ce43b97c15e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:10.519175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fc41f-477a-4723-84f1-ce43b97c15e0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-9f9fc41f-477a-4723-84f1-ce43b97c15e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:10.528581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:10.529573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:10.530390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 353/710] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:22:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:10.537625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573993-38c1-4792-8a55-c57c4e2c5d5e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:10.642994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573993-38c1-4792-8a55-c57c4e2c5d5e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:10.645758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:10.686180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854381f-8382-4d2a-9350-6d9c6bc86e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:10.687151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854381f-8382-4d2a-9350-6d9c6bc86e11 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:10.687647 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854381f-8382-4d2a-9350-6d9c6bc86e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:10.688113 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854381f-8382-4d2a-9350-6d9c6bc86e11 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:10.688972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854381f-8382-4d2a-9350-6d9c6bc86e11 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:10.689466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854381f-8382-4d2a-9350-6d9c6bc86e11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:10.691023 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854381f-8382-4d2a-9350-6d9c6bc86e11 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:10.697551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 358/711] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:22:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:10.704040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fc41f-477a-4723-84f1-ce43b97c15e0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:10.809706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fc41f-477a-4723-84f1-ce43b97c15e0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:10.844701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dcba6-cc44-4361-8d5f-ade4b83c70e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:10.845308 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dcba6-cc44-4361-8d5f-ade4b83c70e9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:10.845581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dcba6-cc44-4361-8d5f-ade4b83c70e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:10.845850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dcba6-cc44-4361-8d5f-ade4b83c70e9 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:10.846467 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dcba6-cc44-4361-8d5f-ade4b83c70e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:10.846764 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dcba6-cc44-4361-8d5f-ade4b83c70e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:10.848103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dcba6-cc44-4361-8d5f-ade4b83c70e9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:10.853396 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 354/712] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:22:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:10.859284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854381f-8382-4d2a-9350-6d9c6bc86e11 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:10.970373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854381f-8382-4d2a-9350-6d9c6bc86e11 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:10.985689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9455d0-83a1-49e7-b69c-c616ff7b887b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:10.985977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9455d0-83a1-49e7-b69c-c616ff7b887b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:10.986232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9455d0-83a1-49e7-b69c-c616ff7b887b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:10.987780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 355/713] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:10.993564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf80af8-28da-4b0e-b1a8-105074a45f4c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:10.994118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf80af8-28da-4b0e-b1a8-105074a45f4c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:10.994118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf80af8-28da-4b0e-b1a8-105074a45f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:11.009488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711d2e9-c197-483f-af0d-1dcb5d1a84e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:11.010399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711d2e9-c197-483f-af0d-1dcb5d1a84e7 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:11.010978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711d2e9-c197-483f-af0d-1dcb5d1a84e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:11.011444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711d2e9-c197-483f-af0d-1dcb5d1a84e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:11.012305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711d2e9-c197-483f-af0d-1dcb5d1a84e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:11.013439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5cf80af8-28da-4b0e-b1a8-105074a45f4c None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:11.014103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711d2e9-c197-483f-af0d-1dcb5d1a84e7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:11.014614 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5cf80af8-28da-4b0e-b1a8-105074a45f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:11.037758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 359/714] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:22:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:11.091003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:11.112131 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 356/715] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:11.388091 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711d2e9-c197-483f-af0d-1dcb5d1a84e7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:11.416709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:11.507780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711d2e9-c197-483f-af0d-1dcb5d1a84e7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:11.543039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2252ae-2e87-4d5d-84fd-feac85d72be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:11.543675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2252ae-2e87-4d5d-84fd-feac85d72be7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:11.543931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2252ae-2e87-4d5d-84fd-feac85d72be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:11.544203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2252ae-2e87-4d5d-84fd-feac85d72be7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:11.544810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2252ae-2e87-4d5d-84fd-feac85d72be7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:11.546178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2252ae-2e87-4d5d-84fd-feac85d72be7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-cf2252ae-2e87-4d5d-84fd-feac85d72be7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:11.556034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:11.557060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:11.557908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 360/716] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:22:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:11.565216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf80af8-28da-4b0e-b1a8-105074a45f4c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:11.600434 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef852c-2b86-489a-9d22-73eaabcc0fb8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:11.601024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef852c-2b86-489a-9d22-73eaabcc0fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:11.602218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef852c-2b86-489a-9d22-73eaabcc0fb8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:11.604577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 361/717] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:11.610511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b3384-9c74-4ebf-b174-908f1f163548 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:11.610864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b3384-9c74-4ebf-b174-908f1f163548 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:11.611143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b3384-9c74-4ebf-b174-908f1f163548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:11.633238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fc4b3384-9c74-4ebf-b174-908f1f163548 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:11.634470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fc4b3384-9c74-4ebf-b174-908f1f163548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:11.682662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf80af8-28da-4b0e-b1a8-105074a45f4c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:11.712746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 362/718] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:11.719280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6401ab-f93b-42a2-b797-ccce789c6fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:11.719899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6401ab-f93b-42a2-b797-ccce789c6fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:11.720346 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6401ab-f93b-42a2-b797-ccce789c6fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:11.720664 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6401ab-f93b-42a2-b797-ccce789c6fa8 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:11.721419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6401ab-f93b-42a2-b797-ccce789c6fa8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:11.721725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6401ab-f93b-42a2-b797-ccce789c6fa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:11.723140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6401ab-f93b-42a2-b797-ccce789c6fa8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:11.727954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0e273-83cc-48e0-b93a-6424ac0fc244 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:11.728297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0e273-83cc-48e0-b93a-6424ac0fc244 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:11.728608 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0e273-83cc-48e0-b93a-6424ac0fc244 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:11.733283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 357/720] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:22:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:11.733971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 363/720] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:11.734204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6401ab-f93b-42a2-b797-ccce789c6fa8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:11.735555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b46650-d02a-4c97-a45a-e14125d7d2b3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:11.735847 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b46650-d02a-4c97-a45a-e14125d7d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:11.736126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b46650-d02a-4c97-a45a-e14125d7d2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:11.755587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b3b46650-d02a-4c97-a45a-e14125d7d2b3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:11.757521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b3b46650-d02a-4c97-a45a-e14125d7d2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:11.774595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:11.781997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:11.845288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6401ab-f93b-42a2-b797-ccce789c6fa8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:11.856600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 364/721] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:11.889442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9861b-2549-4c69-ac3a-dd5279b9d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:11.890043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9861b-2549-4c69-ac3a-dd5279b9d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:11.890325 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9861b-2549-4c69-ac3a-dd5279b9d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:11.890660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9861b-2549-4c69-ac3a-dd5279b9d7a0 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:11.891328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9861b-2549-4c69-ac3a-dd5279b9d7a0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:11.891636 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9861b-2549-4c69-ac3a-dd5279b9d7a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:11.893027 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9861b-2549-4c69-ac3a-dd5279b9d7a0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:11.898309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 358/722] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Nov 2 03:22:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:11.903994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b46650-d02a-4c97-a45a-e14125d7d2b3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:12.006126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b46650-d02a-4c97-a45a-e14125d7d2b3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:12.028106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9861b-2549-4c69-ac3a-dd5279b9d7a0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:12.059052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d3072-14e9-493c-b9cd-b95800e9cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:12.060089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d3072-14e9-493c-b9cd-b95800e9cca2 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:12.060972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d3072-14e9-493c-b9cd-b95800e9cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:12.061250 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d3072-14e9-493c-b9cd-b95800e9cca2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:12.062289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d3072-14e9-493c-b9cd-b95800e9cca2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:12.063980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d3072-14e9-493c-b9cd-b95800e9cca2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:12.094246 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 365/723] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:22:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:12.145312 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d3072-14e9-493c-b9cd-b95800e9cca2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:12.151483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:12.173137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9861b-2549-4c69-ac3a-dd5279b9d7a0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:12.184054 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:12.221919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689feea1-853b-4658-b61e-1ff7c1d07b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:12.222567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689feea1-853b-4658-b61e-1ff7c1d07b35 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:12.222849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689feea1-853b-4658-b61e-1ff7c1d07b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:12.223121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689feea1-853b-4658-b61e-1ff7c1d07b35 None admin] PATH_INFO: `/v3/services/image` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:12.223764 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689feea1-853b-4658-b61e-1ff7c1d07b35 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:12.225277 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689feea1-853b-4658-b61e-1ff7c1d07b35 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-689feea1-853b-4658-b61e-1ff7c1d07b35 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:12.235774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:12.236902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:12.237748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 359/724] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Nov 2 03:22:12 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:12.243332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689feea1-853b-4658-b61e-1ff7c1d07b35 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:12.293517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d3072-14e9-493c-b9cd-b95800e9cca2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:12.337116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55532b38-b94f-4f10-8bad-7ac988958985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:12.337331 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55532b38-b94f-4f10-8bad-7ac988958985 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:12.337561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55532b38-b94f-4f10-8bad-7ac988958985 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:12.337781 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55532b38-b94f-4f10-8bad-7ac988958985 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:12.339151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55532b38-b94f-4f10-8bad-7ac988958985 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:12.339732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55532b38-b94f-4f10-8bad-7ac988958985 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-55532b38-b94f-4f10-8bad-7ac988958985 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:12.350225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:12.351351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:12.352190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 366/725] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:22:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:12.357692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55532b38-b94f-4f10-8bad-7ac988958985 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:12.376121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689feea1-853b-4658-b61e-1ff7c1d07b35 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:12.414885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d5b50-4c53-4182-b03b-3a90811a4940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:12.415501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5b50-4c53-4182-b03b-3a90811a4940 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:12.415783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5b50-4c53-4182-b03b-3a90811a4940 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:12.416104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5b50-4c53-4182-b03b-3a90811a4940 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:12.416764 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d5b50-4c53-4182-b03b-3a90811a4940 None admin] RBAC: Adding query filter params (name=image) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:12.417072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d5b50-4c53-4182-b03b-3a90811a4940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:12.418631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d5b50-4c53-4182-b03b-3a90811a4940 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:12.424789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 360/726] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:12.437624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d5b50-4c53-4182-b03b-3a90811a4940 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:12.448572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:12.479668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:12.487424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55532b38-b94f-4f10-8bad-7ac988958985 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:12.525640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f817078-e3bf-454d-9101-fc2dfcb00be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:12.526689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817078-e3bf-454d-9101-fc2dfcb00be5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:12.527167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817078-e3bf-454d-9101-fc2dfcb00be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:12.527630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817078-e3bf-454d-9101-fc2dfcb00be5 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:12.528475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f817078-e3bf-454d-9101-fc2dfcb00be5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:12.528989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f817078-e3bf-454d-9101-fc2dfcb00be5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:12.530656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f817078-e3bf-454d-9101-fc2dfcb00be5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:12.536257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 367/727] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:22:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:12.548724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f817078-e3bf-454d-9101-fc2dfcb00be5 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:12.556338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d5b50-4c53-4182-b03b-3a90811a4940 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:12.593591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27799d-8827-411e-b8b4-63a1403d4655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:12.594200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27799d-8827-411e-b8b4-63a1403d4655 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:12.594479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27799d-8827-411e-b8b4-63a1403d4655 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:12.594752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27799d-8827-411e-b8b4-63a1403d4655 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:12.595379 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27799d-8827-411e-b8b4-63a1403d4655 None admin] RBAC: Adding query filter params (type=image) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:12.595684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27799d-8827-411e-b8b4-63a1403d4655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:12.597067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27799d-8827-411e-b8b4-63a1403d4655 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:12.613058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 361/728] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:12.674079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f817078-e3bf-454d-9101-fc2dfcb00be5 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:12.707940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:12.713609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa9abc-c864-4331-ad2d-ec9d7a3f2c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:12.714248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa9abc-c864-4331-ad2d-ec9d7a3f2c6b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:12.714536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa9abc-c864-4331-ad2d-ec9d7a3f2c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:12.715040 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa9abc-c864-4331-ad2d-ec9d7a3f2c6b None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:12.715668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa9abc-c864-4331-ad2d-ec9d7a3f2c6b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:12.716132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa9abc-c864-4331-ad2d-ec9d7a3f2c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:12.717660 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa9abc-c864-4331-ad2d-ec9d7a3f2c6b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:12.728390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 368/729] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:22:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:13.293967 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfb73d-1ff1-4fee-9b60-8683f9e646a8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:13.294466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfb73d-1ff1-4fee-9b60-8683f9e646a8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:13.294466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfb73d-1ff1-4fee-9b60-8683f9e646a8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:13.295746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 362/730] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:13.301232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f016598-f5ce-4bfb-9c9e-ef81b62818bc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:13.301519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f016598-f5ce-4bfb-9c9e-ef81b62818bc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:13.301796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f016598-f5ce-4bfb-9c9e-ef81b62818bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:13.320922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6f016598-f5ce-4bfb-9c9e-ef81b62818bc None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:13.322103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6f016598-f5ce-4bfb-9c9e-ef81b62818bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:13.389808 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 369/731] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:13.660628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfb73d-1ff1-4fee-9b60-8683f9e646a8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:13.764832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:13.773690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfb73d-1ff1-4fee-9b60-8683f9e646a8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:13.809566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6abc5e-526d-4c50-ae00-1b4acb91a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:13.810200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6abc5e-526d-4c50-ae00-1b4acb91a14e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:13.810483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6abc5e-526d-4c50-ae00-1b4acb91a14e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:13.810754 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6abc5e-526d-4c50-ae00-1b4acb91a14e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:13.811330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6abc5e-526d-4c50-ae00-1b4acb91a14e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:13.812772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6abc5e-526d-4c50-ae00-1b4acb91a14e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8c6abc5e-526d-4c50-ae00-1b4acb91a14e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:13.821859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:13.822816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:13.823637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 363/732] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:22:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:13.828883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f016598-f5ce-4bfb-9c9e-ef81b62818bc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:13.935142 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f016598-f5ce-4bfb-9c9e-ef81b62818bc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:13.962830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:13.971983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0ed58-a222-4361-a2cb-4c04e71dec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:13.972624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0ed58-a222-4361-a2cb-4c04e71dec3d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:13.972911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0ed58-a222-4361-a2cb-4c04e71dec3d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:13.973187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0ed58-a222-4361-a2cb-4c04e71dec3d None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:13.973823 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0ed58-a222-4361-a2cb-4c04e71dec3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:13.974189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0ed58-a222-4361-a2cb-4c04e71dec3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:13.976761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0ed58-a222-4361-a2cb-4c04e71dec3d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:13.981975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 370/733] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:22:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:13.987293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6abc5e-526d-4c50-ae00-1b4acb91a14e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:14.105594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6abc5e-526d-4c50-ae00-1b4acb91a14e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:14.142860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc60cb0-8140-443a-bce1-f1e698360286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:14.143513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc60cb0-8140-443a-bce1-f1e698360286 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:14.143802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc60cb0-8140-443a-bce1-f1e698360286 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:14.144075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc60cb0-8140-443a-bce1-f1e698360286 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:14.144726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc60cb0-8140-443a-bce1-f1e698360286 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:14.145035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc60cb0-8140-443a-bce1-f1e698360286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:14.146390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc60cb0-8140-443a-bce1-f1e698360286 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:14.152587 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 364/734] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:22:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:14.161846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0ed58-a222-4361-a2cb-4c04e71dec3d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:14.269462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0ed58-a222-4361-a2cb-4c04e71dec3d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:14.305364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad713-842b-4ba9-83e9-3bb97c8f1982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:14.305970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad713-842b-4ba9-83e9-3bb97c8f1982 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:14.306249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad713-842b-4ba9-83e9-3bb97c8f1982 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:14.306522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad713-842b-4ba9-83e9-3bb97c8f1982 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:14.307287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ad713-842b-4ba9-83e9-3bb97c8f1982 None admin] RBAC: Adding query filter params (interface=admin, service_id=837e833e40bd4b1a8ea0851a66e26680, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:14.307695 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ad713-842b-4ba9-83e9-3bb97c8f1982 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:14.309141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ad713-842b-4ba9-83e9-3bb97c8f1982 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:14.314787 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 371/735] 10.222.0.20 () {56 vars in 1249 bytes} [Wed Nov 2 03:22:14 2022] GET /identity/v3/endpoints?service_id=837e833e40bd4b1a8ea0851a66e26680&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:14.320793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc60cb0-8140-443a-bce1-f1e698360286 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:14.345405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:14.427437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc60cb0-8140-443a-bce1-f1e698360286 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:14.464255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b7ade-b46c-4800-ab3d-d4f6e7e4749f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:14.464891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b7ade-b46c-4800-ab3d-d4f6e7e4749f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:14.465169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b7ade-b46c-4800-ab3d-d4f6e7e4749f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:14.465440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b7ade-b46c-4800-ab3d-d4f6e7e4749f None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:14.466035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b7ade-b46c-4800-ab3d-d4f6e7e4749f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:14.467380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b7ade-b46c-4800-ab3d-d4f6e7e4749f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:14.473767 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 365/736] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Nov 2 03:22:14 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:22:14.537683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19c7ba-94a2-415c-a7f2-b464bd3d609d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:14.538550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19c7ba-94a2-415c-a7f2-b464bd3d609d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:14.539335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19c7ba-94a2-415c-a7f2-b464bd3d609d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:14.541135 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 372/737] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:14.546963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e93ddb-bde4-419a-af3d-a97efd54e371 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:14.547242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e93ddb-bde4-419a-af3d-a97efd54e371 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:14.547516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e93ddb-bde4-419a-af3d-a97efd54e371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:14.572111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-09e93ddb-bde4-419a-af3d-a97efd54e371 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:14.573377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-09e93ddb-bde4-419a-af3d-a97efd54e371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:14.650990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 366/738] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:14.884162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c8ef8-2778-4883-99d5-674428e25b6c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:14.885186 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c8ef8-2778-4883-99d5-674428e25b6c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:14.885677 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c8ef8-2778-4883-99d5-674428e25b6c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:14.887450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 373/739] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:14.893192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a778e-5961-4a51-af2b-cd42c53464a0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:14.893722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a778e-5961-4a51-af2b-cd42c53464a0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:14.894190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a778e-5961-4a51-af2b-cd42c53464a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:14.913391 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-677a778e-5961-4a51-af2b-cd42c53464a0 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:14.914960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-677a778e-5961-4a51-af2b-cd42c53464a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:14.926441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:14.936223 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c8ef8-2778-4883-99d5-674428e25b6c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:15.012530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 367/740] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:15.019298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:15.068003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb734f-821c-4bf1-84b5-94a536865cf0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:15.068311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb734f-821c-4bf1-84b5-94a536865cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:15.068573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb734f-821c-4bf1-84b5-94a536865cf0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:15.070337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 368/741] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:15.073113 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c8ef8-2778-4883-99d5-674428e25b6c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:15.075964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e1d19-7615-42d9-a84a-3ccb5c420288 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:15.076541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e1d19-7615-42d9-a84a-3ccb5c420288 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:15.077029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e1d19-7615-42d9-a84a-3ccb5c420288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:15.106240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-282e1d19-7615-42d9-a84a-3ccb5c420288 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:15.107922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-282e1d19-7615-42d9-a84a-3ccb5c420288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:15.121620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:15.122239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:15.122614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:15.122877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:15.123710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:15.125309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:15.128479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WARNING keystone.server.flask.common [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 03:22:15.151724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.sql.core [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 03:22:15.151724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 03:22:15.151724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [parameters: {'id': '2b2b918f2cc24dd79033380b1600a0d3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 03:22:15.151724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81396) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b2b918f2cc24dd79033380b1600a0d3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b2b918f2cc24dd79033380b1600a0d3. Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application conn.query(q) Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 03:22:15.161958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result.read() Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 03:22:15.163441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application next(self.gen) Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application yield resource Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application next(self.gen) Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise self.value Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application session.commit() Nov 02 03:22:15.164514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.session.flush() Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application compat.raise_( Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 03:22:15.166053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 03:22:15.166939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application conn.query(q) Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result.read() Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 03:22:15.167709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [parameters: {'id': '2b2b918f2cc24dd79033380b1600a0d3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:15.169541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:15.171388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b2b918f2cc24dd79033380b1600a0d3. Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 374/742] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Nov 2 03:22:14 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:15.173515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:15.208246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 369/743] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:15.295190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa55a40-070a-4409-a0cd-3d01f54c6a81 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:15.310407 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:15.316198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e1d19-7615-42d9-a84a-3ccb5c420288 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:15.342709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdd054-5a06-4421-89b4-b2da17edbdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:15.343377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdd054-5a06-4421-89b4-b2da17edbdcc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:15.343654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdd054-5a06-4421-89b4-b2da17edbdcc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:15.343922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdd054-5a06-4421-89b4-b2da17edbdcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:15.354102 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdd054-5a06-4421-89b4-b2da17edbdcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:15.357022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdd054-5a06-4421-89b4-b2da17edbdcc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e9bdd054-5a06-4421-89b4-b2da17edbdcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:22:15.376215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:15.377602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:15.379300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:22:15.379300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:22:15.379300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:22:15.379300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:22:15.379300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:22:15.379300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:22:15.379300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:22:15.379300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:15.383037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 375/744] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:22:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:15.389166 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdd054-5a06-4421-89b4-b2da17edbdcc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:15.425268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:15.451058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e1d19-7615-42d9-a84a-3ccb5c420288 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:15.494300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013faef-ef2c-406f-a6b3-6cb9fcfe04a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:15.495187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013faef-ef2c-406f-a6b3-6cb9fcfe04a7 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:15.495612 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013faef-ef2c-406f-a6b3-6cb9fcfe04a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:15.496030 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013faef-ef2c-406f-a6b3-6cb9fcfe04a7 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:15.497029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013faef-ef2c-406f-a6b3-6cb9fcfe04a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:15.498789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013faef-ef2c-406f-a6b3-6cb9fcfe04a7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:15.513215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdd054-5a06-4421-89b4-b2da17edbdcc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:15.522771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 370/745] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:22:15 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:15.522771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013faef-ef2c-406f-a6b3-6cb9fcfe04a7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:15.573137 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38f37a-6add-4e34-a01d-37b266424ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:15.574157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f37a-6add-4e34-a01d-37b266424ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:15.574438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f37a-6add-4e34-a01d-37b266424ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:15.574710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f37a-6add-4e34-a01d-37b266424ff0 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:15.577866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38f37a-6add-4e34-a01d-37b266424ff0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:15.578186 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38f37a-6add-4e34-a01d-37b266424ff0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:15.579964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38f37a-6add-4e34-a01d-37b266424ff0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:15.604529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 376/746] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:22:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:15.650591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013faef-ef2c-406f-a6b3-6cb9fcfe04a7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:15.692115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eeb215-036e-4dcc-b771-ef41f1596e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:15.693158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeb215-036e-4dcc-b771-ef41f1596e39 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:15.693640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeb215-036e-4dcc-b771-ef41f1596e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:15.694804 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeb215-036e-4dcc-b771-ef41f1596e39 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:15.696079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eeb215-036e-4dcc-b771-ef41f1596e39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:15.697832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eeb215-036e-4dcc-b771-ef41f1596e39 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:15.703064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:15.721818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 371/747] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:22:15 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:16.829668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926fa75-4e7d-4fa2-930d-713432a0f107 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:16.830480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926fa75-4e7d-4fa2-930d-713432a0f107 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:16.830480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926fa75-4e7d-4fa2-930d-713432a0f107 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:16.831808 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 377/748] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:16.837649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfd894-4903-4ad0-bdb0-f8a8443db8c9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:16.838092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfd894-4903-4ad0-bdb0-f8a8443db8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:16.838286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfd894-4903-4ad0-bdb0-f8a8443db8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:16.858117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-63dfd894-4903-4ad0-bdb0-f8a8443db8c9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:16.859315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63dfd894-4903-4ad0-bdb0-f8a8443db8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:16.946092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 372/749] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:17.232877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926fa75-4e7d-4fa2-930d-713432a0f107 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:17.264132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:17.358717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926fa75-4e7d-4fa2-930d-713432a0f107 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:17.394618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8bef-97f9-4334-92b0-eebbacf70477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:17.395640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8bef-97f9-4334-92b0-eebbacf70477 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:17.396127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8bef-97f9-4334-92b0-eebbacf70477 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:17.396615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8bef-97f9-4334-92b0-eebbacf70477 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:17.398235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8bef-97f9-4334-92b0-eebbacf70477 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:17.399790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8bef-97f9-4334-92b0-eebbacf70477 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-daba8bef-97f9-4334-92b0-eebbacf70477 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:17.409004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:17.410016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 03:22:17.410853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:17.414851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 378/750] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Nov 2 03:22:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:17.420947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfd894-4903-4ad0-bdb0-f8a8443db8c9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:17.525567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfd894-4903-4ad0-bdb0-f8a8443db8c9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:17.550380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:17.564065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc8436-97f6-4208-947f-a94d00a44457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:17.565076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc8436-97f6-4208-947f-a94d00a44457 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:17.565555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc8436-97f6-4208-947f-a94d00a44457 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:17.566022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc8436-97f6-4208-947f-a94d00a44457 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:17.566846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc8436-97f6-4208-947f-a94d00a44457 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:17.567340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc8436-97f6-4208-947f-a94d00a44457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:17.569599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc8436-97f6-4208-947f-a94d00a44457 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:17.575878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 373/751] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:22:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:17.581554 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8bef-97f9-4334-92b0-eebbacf70477 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:17.677817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:17.688248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8bef-97f9-4334-92b0-eebbacf70477 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:17.726347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903bcab-ed75-4bb1-bd39-1acfeb807d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:17.726954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903bcab-ed75-4bb1-bd39-1acfeb807d3a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:17.727234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903bcab-ed75-4bb1-bd39-1acfeb807d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:17.727502 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903bcab-ed75-4bb1-bd39-1acfeb807d3a None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:17.728129 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903bcab-ed75-4bb1-bd39-1acfeb807d3a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:17.728428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903bcab-ed75-4bb1-bd39-1acfeb807d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:17.729923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903bcab-ed75-4bb1-bd39-1acfeb807d3a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:17.735755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 379/752] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Nov 2 03:22:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:17.745621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc8436-97f6-4208-947f-a94d00a44457 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:17.853860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc8436-97f6-4208-947f-a94d00a44457 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:17.893417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ac440-e490-4b91-a9a2-075cd584c502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:17.894146 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac440-e490-4b91-a9a2-075cd584c502 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:17.894428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac440-e490-4b91-a9a2-075cd584c502 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:17.894695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac440-e490-4b91-a9a2-075cd584c502 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:17.895364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ac440-e490-4b91-a9a2-075cd584c502 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:17.896764 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ac440-e490-4b91-a9a2-075cd584c502 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:17.917205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 374/753] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:22:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:18.001374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989418e-0eb7-443a-bc29-c42e50bba4b9 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.002399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989418e-0eb7-443a-bc29-c42e50bba4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.002889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989418e-0eb7-443a-bc29-c42e50bba4b9 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.004970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 380/754] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:18.012088 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6a26-3243-497c-b741-fd8f3c2be5d7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.012774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6a26-3243-497c-b741-fd8f3c2be5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.013255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6a26-3243-497c-b741-fd8f3c2be5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.034478 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c9ae6a26-3243-497c-b741-fd8f3c2be5d7 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:18.036131 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c9ae6a26-3243-497c-b741-fd8f3c2be5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:18.066241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c89f5-ead4-4c4a-a1e1-e751d1231a94 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.066897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c89f5-ead4-4c4a-a1e1-e751d1231a94 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.067372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c89f5-ead4-4c4a-a1e1-e751d1231a94 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.070002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 381/755] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:18.078259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371bcfa-fdaa-423f-b0b1-3f4f947962e1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.078970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371bcfa-fdaa-423f-b0b1-3f4f947962e1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.079543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371bcfa-fdaa-423f-b0b1-3f4f947962e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.101291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e371bcfa-fdaa-423f-b0b1-3f4f947962e1 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:18.103260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e371bcfa-fdaa-423f-b0b1-3f4f947962e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:18.104580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:18.142598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 375/756] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:18 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:18.143692 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995e5b-8fa4-422b-a364-e498c6b55e59 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.143978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995e5b-8fa4-422b-a364-e498c6b55e59 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.144253 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995e5b-8fa4-422b-a364-e498c6b55e59 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.152539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 376/757] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:18.153775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1462c-03cc-4e49-ab37-670882c159fa None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.154064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1462c-03cc-4e49-ab37-670882c159fa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.154346 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1462c-03cc-4e49-ab37-670882c159fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.179228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-eff1462c-03cc-4e49-ab37-670882c159fa None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:18.180420 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eff1462c-03cc-4e49-ab37-670882c159fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:18.181100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 382/758] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:18 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:18.259149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 377/759] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:18 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:18.421549 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371bcfa-fdaa-423f-b0b1-3f4f947962e1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:18.461633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1462c-03cc-4e49-ab37-670882c159fa None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:18.509282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:18.525821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371bcfa-fdaa-423f-b0b1-3f4f947962e1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:18.561465 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21572bd-1cef-43a9-b8f0-7dd5274429e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:18.562138 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21572bd-1cef-43a9-b8f0-7dd5274429e7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.562364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21572bd-1cef-43a9-b8f0-7dd5274429e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.562634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21572bd-1cef-43a9-b8f0-7dd5274429e7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.563204 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21572bd-1cef-43a9-b8f0-7dd5274429e7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:18.564590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21572bd-1cef-43a9-b8f0-7dd5274429e7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-e21572bd-1cef-43a9-b8f0-7dd5274429e7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:18.573809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:18.574786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:18.575640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 383/760] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Nov 2 03:22:18 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:18.577122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21572bd-1cef-43a9-b8f0-7dd5274429e7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:18.584741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1462c-03cc-4e49-ab37-670882c159fa None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:18.586288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:18.622525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:18.623144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.623423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.623693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.624332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:18.625799 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:18.628378 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING keystone.server.flask.common [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 03:22:18.640952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.sql.core [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 03:22:18.640952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 03:22:18.640952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [parameters: {'user_id': '9e7e1a2402774909a770e888660637b7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 03:22:18.640952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Nov 02 03:22:18.647979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 03:22:18.649058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application yield resource Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise self.value Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application session.commit() Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 03:22:18.650007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.flush() Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application compat.raise_( Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 03:22:18.650943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = connection._execute_20( Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 03:22:18.651789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 03:22:18.652631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [parameters: {'user_id': '9e7e1a2402774909a770e888660637b7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:18.653442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Nov 02 03:22:18.654193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Nov 02 03:22:18.655065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Nov 02 03:22:18.655065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Nov 02 03:22:18.655065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 03:22:18.655065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 03:22:18.655065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 03:22:18.655065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:18.655065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 378/761] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Nov 2 03:22:18 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:18.655065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:18.694442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21572bd-1cef-43a9-b8f0-7dd5274429e7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:18.731843 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e9087-19b6-4473-b1c1-ceda9de3349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:18.732927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e9087-19b6-4473-b1c1-ceda9de3349b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.733210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e9087-19b6-4473-b1c1-ceda9de3349b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.733480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e9087-19b6-4473-b1c1-ceda9de3349b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.734119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e9087-19b6-4473-b1c1-ceda9de3349b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:18.735494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e9087-19b6-4473-b1c1-ceda9de3349b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-212e9087-19b6-4473-b1c1-ceda9de3349b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:18.745693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:18.746726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:18.748144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 384/762] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:22:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:18.748980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e9087-19b6-4473-b1c1-ceda9de3349b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:18.767803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:18.768595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e438c-9bf4-4bd4-8892-ef24126b3a94 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:18.812864 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c49ff0-8322-4cf0-aca4-524f14c7af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:18.813417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c49ff0-8322-4cf0-aca4-524f14c7af90 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.813703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c49ff0-8322-4cf0-aca4-524f14c7af90 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.813976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c49ff0-8322-4cf0-aca4-524f14c7af90 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.814777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c49ff0-8322-4cf0-aca4-524f14c7af90 None admin] RBAC: Adding query filter params (name=image) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:18.815412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c49ff0-8322-4cf0-aca4-524f14c7af90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:18.817342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c49ff0-8322-4cf0-aca4-524f14c7af90 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:18.826829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 379/763] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:18.827344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c49ff0-8322-4cf0-aca4-524f14c7af90 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:18.858937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:18.862625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e9087-19b6-4473-b1c1-ceda9de3349b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:18.902844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9530-d0fb-4efc-9004-6c31e624471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:18.903478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9530-d0fb-4efc-9004-6c31e624471c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.903763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9530-d0fb-4efc-9004-6c31e624471c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.904037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9530-d0fb-4efc-9004-6c31e624471c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.911963 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd9530-d0fb-4efc-9004-6c31e624471c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:18.913999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd9530-d0fb-4efc-9004-6c31e624471c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-5bdd9530-d0fb-4efc-9004-6c31e624471c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:22:18.925965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:18.926892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:18.927835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:18.927835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:18.927835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:22:18.927835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:22:18.927835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:22:18.927835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:22:18.927835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:22:18.927835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:22:18.927835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 03:22:18.927835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:18.932833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 385/764] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:22:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:18.933531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9530-d0fb-4efc-9004-6c31e624471c None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:18.940496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c49ff0-8322-4cf0-aca4-524f14c7af90 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:18.976923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bb10b-5f08-4d7b-9aae-31386c49be22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:18.977540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bb10b-5f08-4d7b-9aae-31386c49be22 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:18.978174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bb10b-5f08-4d7b-9aae-31386c49be22 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:18.978452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bb10b-5f08-4d7b-9aae-31386c49be22 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:18.979388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bb10b-5f08-4d7b-9aae-31386c49be22 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:18.979700 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bb10b-5f08-4d7b-9aae-31386c49be22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:18.981226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bb10b-5f08-4d7b-9aae-31386c49be22 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:18.986209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 380/765] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:22:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:18.986902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bb10b-5f08-4d7b-9aae-31386c49be22 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:19.013354 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:19.046468 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9530-d0fb-4efc-9004-6c31e624471c None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:19.084104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4562b-06e5-47dc-8cdd-96ee35ee70dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:19.085824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4562b-06e5-47dc-8cdd-96ee35ee70dd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:19.086415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4562b-06e5-47dc-8cdd-96ee35ee70dd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:19.086702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4562b-06e5-47dc-8cdd-96ee35ee70dd None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:19.087337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4562b-06e5-47dc-8cdd-96ee35ee70dd None admin] RBAC: Adding query filter params (type=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:19.087766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4562b-06e5-47dc-8cdd-96ee35ee70dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:19.089169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4562b-06e5-47dc-8cdd-96ee35ee70dd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:19.091273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:19.095828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 386/766] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:19.096540 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4562b-06e5-47dc-8cdd-96ee35ee70dd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:19.106981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bb10b-5f08-4d7b-9aae-31386c49be22 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:19.144899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceea7f9-5721-45cc-bfe6-c005d5f0ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:19.145509 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceea7f9-5721-45cc-bfe6-c005d5f0ef0c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:19.145787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceea7f9-5721-45cc-bfe6-c005d5f0ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:19.146078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceea7f9-5721-45cc-bfe6-c005d5f0ef0c None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:19.146745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceea7f9-5721-45cc-bfe6-c005d5f0ef0c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:19.147463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceea7f9-5721-45cc-bfe6-c005d5f0ef0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:19.148940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceea7f9-5721-45cc-bfe6-c005d5f0ef0c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:19.192487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 381/767] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Nov 2 03:22:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:19.192487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceea7f9-5721-45cc-bfe6-c005d5f0ef0c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:19.201871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4562b-06e5-47dc-8cdd-96ee35ee70dd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:19.244234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f87eb2-65c3-4dc6-8130-ea7c18ad2684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:19.244799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f87eb2-65c3-4dc6-8130-ea7c18ad2684 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:19.245077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f87eb2-65c3-4dc6-8130-ea7c18ad2684 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:19.245357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f87eb2-65c3-4dc6-8130-ea7c18ad2684 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:19.245973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f87eb2-65c3-4dc6-8130-ea7c18ad2684 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:19.246275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f87eb2-65c3-4dc6-8130-ea7c18ad2684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:19.247672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f87eb2-65c3-4dc6-8130-ea7c18ad2684 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:19.252389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:19.258336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 387/768] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:22:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:19.264958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f87eb2-65c3-4dc6-8130-ea7c18ad2684 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:19.333786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceea7f9-5721-45cc-bfe6-c005d5f0ef0c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:19.376104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5714e-c430-49dd-93c6-00606f83dd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:19.377153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5714e-c430-49dd-93c6-00606f83dd19 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:19.377632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5714e-c430-49dd-93c6-00606f83dd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:19.378208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5714e-c430-49dd-93c6-00606f83dd19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:19.379212 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5714e-c430-49dd-93c6-00606f83dd19 None admin] RBAC: Adding query filter params (interface=public, service_id=b8a12c865abe4e0885bd5544664f44ad, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:19.379722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5714e-c430-49dd-93c6-00606f83dd19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:19.382058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5714e-c430-49dd-93c6-00606f83dd19 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:19.388296 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 382/769] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Nov 2 03:22:19 2022] GET /identity/v3/endpoints?service_id=b8a12c865abe4e0885bd5544664f44ad&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:19.394429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5714e-c430-49dd-93c6-00606f83dd19 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:19.398654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f87eb2-65c3-4dc6-8130-ea7c18ad2684 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:19.416191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:19.450208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0912c4-a278-4e44-b4ce-98b7ccbd36c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:19.451484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0912c4-a278-4e44-b4ce-98b7ccbd36c1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:19.451991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0912c4-a278-4e44-b4ce-98b7ccbd36c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:19.452485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0912c4-a278-4e44-b4ce-98b7ccbd36c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:19.453697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0912c4-a278-4e44-b4ce-98b7ccbd36c1 None admin] RBAC: Adding query filter params (interface=public, service_id=1438bafa0485499fb548f4a6818c17f3, region_id=RegionOne) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:19.454213 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0912c4-a278-4e44-b4ce-98b7ccbd36c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:19.456592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0912c4-a278-4e44-b4ce-98b7ccbd36c1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:19.462452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 388/770] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Nov 2 03:22:19 2022] GET /identity/v3/endpoints?service_id=1438bafa0485499fb548f4a6818c17f3&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:19.467990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0912c4-a278-4e44-b4ce-98b7ccbd36c1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:19.527418 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5714e-c430-49dd-93c6-00606f83dd19 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:19.547328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:19.568095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d028613-ceed-42c1-9f74-cef81ac03fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:19.568980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d028613-ceed-42c1-9f74-cef81ac03fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:19.570633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d028613-ceed-42c1-9f74-cef81ac03fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:19.570930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d028613-ceed-42c1-9f74-cef81ac03fc4 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:19.571538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d028613-ceed-42c1-9f74-cef81ac03fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:19.573097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d028613-ceed-42c1-9f74-cef81ac03fc4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:19.579963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 383/771] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Nov 2 03:22:19 2022] GET /identity/v3/services => generated 1957 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:22:19.605752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0912c4-a278-4e44-b4ce-98b7ccbd36c1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:19.646219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1358a4-c278-483b-b822-23b849610af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:19.647334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1358a4-c278-483b-b822-23b849610af5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:19.648257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1358a4-c278-483b-b822-23b849610af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:19.648577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1358a4-c278-483b-b822-23b849610af5 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:19.649198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1358a4-c278-483b-b822-23b849610af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:19.650615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1358a4-c278-483b-b822-23b849610af5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:19.664758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 389/772] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Nov 2 03:22:19 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:22:20.171145 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb152-fec8-438b-90fd-c99354018bf2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:20.171693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb152-fec8-438b-90fd-c99354018bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:20.171693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb152-fec8-438b-90fd-c99354018bf2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:20.173194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 384/773] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:20.178314 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e66c8a-0a5b-4e5b-8711-ecc865dde1bc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:20.178776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e66c8a-0a5b-4e5b-8711-ecc865dde1bc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:20.178867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e66c8a-0a5b-4e5b-8711-ecc865dde1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:20.197296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-28e66c8a-0a5b-4e5b-8711-ecc865dde1bc None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:20.198473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-28e66c8a-0a5b-4e5b-8711-ecc865dde1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:20.268611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 390/774] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:20.536713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eb152-fec8-438b-90fd-c99354018bf2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:20.618010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:20.644816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eb152-fec8-438b-90fd-c99354018bf2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:20.679271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fafb33-d8af-4e45-9461-db2103cb4be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:20.679887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fafb33-d8af-4e45-9461-db2103cb4be3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:20.680164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fafb33-d8af-4e45-9461-db2103cb4be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:20.680657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fafb33-d8af-4e45-9461-db2103cb4be3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:20.681741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fafb33-d8af-4e45-9461-db2103cb4be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:20.683148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fafb33-d8af-4e45-9461-db2103cb4be3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:20.684900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 385/775] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:20.690434 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e66c8a-0a5b-4e5b-8711-ecc865dde1bc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:20.747759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:20.790698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e66c8a-0a5b-4e5b-8711-ecc865dde1bc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:20.824056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96081aaf-3b57-4113-9c9f-ecdbe9bb17ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:20.824684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96081aaf-3b57-4113-9c9f-ecdbe9bb17ab None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:20.824963 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96081aaf-3b57-4113-9c9f-ecdbe9bb17ab None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:20.825233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96081aaf-3b57-4113-9c9f-ecdbe9bb17ab None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:20.825881 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96081aaf-3b57-4113-9c9f-ecdbe9bb17ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:20.827293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96081aaf-3b57-4113-9c9f-ecdbe9bb17ab None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:20.854996 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 391/776] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:22:20 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:21.804069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ccd8f-faa6-4423-a256-1a356dbd447f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:21.804665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ccd8f-faa6-4423-a256-1a356dbd447f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:21.804665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ccd8f-faa6-4423-a256-1a356dbd447f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:21.806012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 386/777] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:21.811261 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515012-df59-4abd-b3ae-d3b184c8f432 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:21.811654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515012-df59-4abd-b3ae-d3b184c8f432 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:21.811821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515012-df59-4abd-b3ae-d3b184c8f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:21.830219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f9515012-df59-4abd-b3ae-d3b184c8f432 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:21.831394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f9515012-df59-4abd-b3ae-d3b184c8f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:21.866571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2d49-0ee6-42d1-a5c1-873b12e629b8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:21.866862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2d49-0ee6-42d1-a5c1-873b12e629b8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:21.867117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2d49-0ee6-42d1-a5c1-873b12e629b8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:21.868596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 387/778] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:21.873592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fdcc0-315e-457a-8996-02f2e9a55ec8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:21.873879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fdcc0-315e-457a-8996-02f2e9a55ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:21.874151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fdcc0-315e-457a-8996-02f2e9a55ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:21.892907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-555fdcc0-315e-457a-8996-02f2e9a55ec8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:21.894465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-555fdcc0-315e-457a-8996-02f2e9a55ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:21.903252 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 392/779] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:21.960526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 388/780] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:22.169038 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9515012-df59-4abd-b3ae-d3b184c8f432 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:22.210183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:22.230230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fdcc0-315e-457a-8996-02f2e9a55ec8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:22.279383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9515012-df59-4abd-b3ae-d3b184c8f432 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:22.315371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf0bd1-20e9-4cc0-af76-eb8b971797f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:22.315997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf0bd1-20e9-4cc0-af76-eb8b971797f7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:22.316274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf0bd1-20e9-4cc0-af76-eb8b971797f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:22.316574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf0bd1-20e9-4cc0-af76-eb8b971797f7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:22.317148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf0bd1-20e9-4cc0-af76-eb8b971797f7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:22.318503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf0bd1-20e9-4cc0-af76-eb8b971797f7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:22.321603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-d7cf0bd1-20e9-4cc0-af76-eb8b971797f7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:22.328679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:22.329652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:22.331188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 393/781] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Nov 2 03:22:22 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:22.336225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf0bd1-20e9-4cc0-af76-eb8b971797f7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:22.348054 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fdcc0-315e-457a-8996-02f2e9a55ec8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:22.386269 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6901e-c095-40d4-b85c-cd6c708dbd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:22.386892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6901e-c095-40d4-b85c-cd6c708dbd55 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:22.387169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6901e-c095-40d4-b85c-cd6c708dbd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:22.387437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6901e-c095-40d4-b85c-cd6c708dbd55 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:22.388006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6901e-c095-40d4-b85c-cd6c708dbd55 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:22.389390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6901e-c095-40d4-b85c-cd6c708dbd55 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3ec6901e-c095-40d4-b85c-cd6c708dbd55 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:22.398282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:22.399241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:22.400052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 389/782] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:22:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:22.405128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6901e-c095-40d4-b85c-cd6c708dbd55 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:22.448256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf0bd1-20e9-4cc0-af76-eb8b971797f7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:22.450616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:22.484586 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bee02-6192-48de-aa8c-4ab3509409ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:22.485186 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bee02-6192-48de-aa8c-4ab3509409ff None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:22.485461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bee02-6192-48de-aa8c-4ab3509409ff None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:22.485729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bee02-6192-48de-aa8c-4ab3509409ff None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:22.486351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bee02-6192-48de-aa8c-4ab3509409ff None admin] RBAC: Adding query filter params (name=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:22.486646 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bee02-6192-48de-aa8c-4ab3509409ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:22.488004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bee02-6192-48de-aa8c-4ab3509409ff None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:22.493921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 394/783] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:22.499550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bee02-6192-48de-aa8c-4ab3509409ff None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:22.517837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6901e-c095-40d4-b85c-cd6c708dbd55 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:22.554688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31cc04-38e6-4107-baab-28b4ca52725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:22.555411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31cc04-38e6-4107-baab-28b4ca52725d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:22.555686 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31cc04-38e6-4107-baab-28b4ca52725d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:22.555951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31cc04-38e6-4107-baab-28b4ca52725d None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:22.556605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31cc04-38e6-4107-baab-28b4ca52725d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:22.556906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31cc04-38e6-4107-baab-28b4ca52725d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:22.558555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31cc04-38e6-4107-baab-28b4ca52725d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:22.564075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 390/784] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:22:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:22.570017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31cc04-38e6-4107-baab-28b4ca52725d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:22.575003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:22.606153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bee02-6192-48de-aa8c-4ab3509409ff None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:22.643889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962d606-c033-40bd-b3a5-c066cbe23a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:22.644929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962d606-c033-40bd-b3a5-c066cbe23a56 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:22.645351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962d606-c033-40bd-b3a5-c066cbe23a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:22.645777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962d606-c033-40bd-b3a5-c066cbe23a56 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:22.646534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962d606-c033-40bd-b3a5-c066cbe23a56 None admin] RBAC: Adding query filter params (type=image) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:22.647634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962d606-c033-40bd-b3a5-c066cbe23a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:22.649342 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962d606-c033-40bd-b3a5-c066cbe23a56 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:22.654929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 395/785] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:22.660085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962d606-c033-40bd-b3a5-c066cbe23a56 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:22.683400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31cc04-38e6-4107-baab-28b4ca52725d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:22.694744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:22.718472 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb152-a31a-4c97-bd2f-129497d6195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:22.719088 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb152-a31a-4c97-bd2f-129497d6195c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:22.719372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb152-a31a-4c97-bd2f-129497d6195c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:22.719651 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb152-a31a-4c97-bd2f-129497d6195c None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:22.720274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fb152-a31a-4c97-bd2f-129497d6195c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:22.720609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fb152-a31a-4c97-bd2f-129497d6195c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:22.721966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fb152-a31a-4c97-bd2f-129497d6195c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:22.731321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 391/786] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Nov 2 03:22:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:22.732381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb152-a31a-4c97-bd2f-129497d6195c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:22.775079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962d606-c033-40bd-b3a5-c066cbe23a56 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:22.802097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:22.812298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94df59-da38-4ba3-b422-92da040b962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:22.812944 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94df59-da38-4ba3-b422-92da040b962f None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:22.813220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94df59-da38-4ba3-b422-92da040b962f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:22.813496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94df59-da38-4ba3-b422-92da040b962f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:22.814158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94df59-da38-4ba3-b422-92da040b962f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:22.815518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94df59-da38-4ba3-b422-92da040b962f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:22.838833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 396/787] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:22:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:22.848208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb152-a31a-4c97-bd2f-129497d6195c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:22.895491 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc34f33-60b1-4b7b-9164-96ec0c8bcb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:22.896118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34f33-60b1-4b7b-9164-96ec0c8bcb86 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:22.896399 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34f33-60b1-4b7b-9164-96ec0c8bcb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:22.897251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34f33-60b1-4b7b-9164-96ec0c8bcb86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:22.897964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc34f33-60b1-4b7b-9164-96ec0c8bcb86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:22.899361 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc34f33-60b1-4b7b-9164-96ec0c8bcb86 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:22.921661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 392/788] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:22:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:23.059028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de603109-396a-486c-b801-c756e0cdee0e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:23.059367 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de603109-396a-486c-b801-c756e0cdee0e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:23.059583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de603109-396a-486c-b801-c756e0cdee0e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:23.061005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 397/789] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:23.067207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ab9e6-eb14-4c47-804b-ba1d07e1ac90 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:23.067496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ab9e6-eb14-4c47-804b-ba1d07e1ac90 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:23.067771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ab9e6-eb14-4c47-804b-ba1d07e1ac90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:23.087343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e32ab9e6-eb14-4c47-804b-ba1d07e1ac90 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:23.088617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e32ab9e6-eb14-4c47-804b-ba1d07e1ac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:23.169666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 393/790] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:23.438015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de603109-396a-486c-b801-c756e0cdee0e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:23.529631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:23.545978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de603109-396a-486c-b801-c756e0cdee0e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:23.580765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f1c82-d551-46ad-a570-b88a89d8356b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:23.581400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f1c82-d551-46ad-a570-b88a89d8356b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:23.581682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f1c82-d551-46ad-a570-b88a89d8356b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:23.581955 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f1c82-d551-46ad-a570-b88a89d8356b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:23.583068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f1c82-d551-46ad-a570-b88a89d8356b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:23.584632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f1c82-d551-46ad-a570-b88a89d8356b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:23.586357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 398/791] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:23.591984 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ab9e6-eb14-4c47-804b-ba1d07e1ac90 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:23.641382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:23.697254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ab9e6-eb14-4c47-804b-ba1d07e1ac90 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:23.732774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff20c9d-27ac-491b-909a-5b1648808f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:23.733493 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff20c9d-27ac-491b-909a-5b1648808f15 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:23.733783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff20c9d-27ac-491b-909a-5b1648808f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:23.734062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff20c9d-27ac-491b-909a-5b1648808f15 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:23.734676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff20c9d-27ac-491b-909a-5b1648808f15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:23.736099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff20c9d-27ac-491b-909a-5b1648808f15 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:23.764501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 394/792] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:22:23 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:22:25.073262 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795b46e-5239-448e-b870-1fd9be0255e6 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:25.073760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795b46e-5239-448e-b870-1fd9be0255e6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:25.073835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795b46e-5239-448e-b870-1fd9be0255e6 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:25.075265 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 399/793] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:25.080217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64117b-5d02-40d8-a9b3-1acf7bc593cd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:25.080619 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64117b-5d02-40d8-a9b3-1acf7bc593cd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:25.080789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64117b-5d02-40d8-a9b3-1acf7bc593cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:25.100711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ad64117b-5d02-40d8-a9b3-1acf7bc593cd None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:25.101949 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ad64117b-5d02-40d8-a9b3-1acf7bc593cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:25.176610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 395/794] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:25.219696 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b5051-d6d8-4d3b-bcf3-17695250215e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:25.220002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b5051-d6d8-4d3b-bcf3-17695250215e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:25.220251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b5051-d6d8-4d3b-bcf3-17695250215e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:25.221729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 400/795] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:25.226772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f094f-76ab-445d-963b-7a1a3a717a65 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:25.227068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f094f-76ab-445d-963b-7a1a3a717a65 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:25.227344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f094f-76ab-445d-963b-7a1a3a717a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:25.246519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e09f094f-76ab-445d-963b-7a1a3a717a65 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:25.247697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e09f094f-76ab-445d-963b-7a1a3a717a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:25.274660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:25.318947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 396/796] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:25.446539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b5051-d6d8-4d3b-bcf3-17695250215e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:25.549894 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b5051-d6d8-4d3b-bcf3-17695250215e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:25.584277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbf8dc-a0a9-4334-8109-7d1c4f0af2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:25.584847 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbf8dc-a0a9-4334-8109-7d1c4f0af2e6 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:25.585123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbf8dc-a0a9-4334-8109-7d1c4f0af2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:25.585394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbf8dc-a0a9-4334-8109-7d1c4f0af2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:25.586158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbf8dc-a0a9-4334-8109-7d1c4f0af2e6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:25.587525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbf8dc-a0a9-4334-8109-7d1c4f0af2e6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:25.588503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f094f-76ab-445d-963b-7a1a3a717a65 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:25.595441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.sql.core [None req-4adbf8dc-a0a9-4334-8109-7d1c4f0af2e6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 03:22:25.595441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 03:22:25.595441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [parameters: {'id': '57155575f9e44654a3544345096e062f', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 03:22:25.595441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81396) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-4adbf8dc-a0a9-4334-8109-7d1c4f0af2e6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application conn.query(q) Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 03:22:25.603736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result.read() Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 03:22:25.604652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application next(self.gen) Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application yield resource Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application next(self.gen) Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise self.value Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application session.commit() Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 03:22:25.605604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.session.flush() Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application compat.raise_( Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 03:22:25.606478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 03:22:25.607356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application conn.query(q) Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application result.read() Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 03:22:25.608198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [parameters: {'id': '57155575f9e44654a3544345096e062f', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 03:22:25.609271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:25.610480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 401/797] 10.222.0.20 () {60 vars in 1137 bytes} [Wed Nov 2 03:22:25 2022] POST /identity/v3/domains => generated 190 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:25.611768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbf8dc-a0a9-4334-8109-7d1c4f0af2e6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:25.634099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:25.714585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f094f-76ab-445d-963b-7a1a3a717a65 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:25.716061 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbf8dc-a0a9-4334-8109-7d1c4f0af2e6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:25.751764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab37c6-2135-4066-b180-bf5b247e8881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:25.752397 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab37c6-2135-4066-b180-bf5b247e8881 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:25.752716 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab37c6-2135-4066-b180-bf5b247e8881 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:25.752986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab37c6-2135-4066-b180-bf5b247e8881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:25.757417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a1c4f-2100-4eae-abe3-dded90c08edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:25.758050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1c4f-2100-4eae-abe3-dded90c08edd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:25.758326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1c4f-2100-4eae-abe3-dded90c08edd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:25.758595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1c4f-2100-4eae-abe3-dded90c08edd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:25.764231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab37c6-2135-4066-b180-bf5b247e8881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:25.765710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab37c6-2135-4066-b180-bf5b247e8881 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:25.769550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a1c4f-2100-4eae-abe3-dded90c08edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8b3a1c4f-2100-4eae-abe3-dded90c08edd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:22:25.775118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:25.776069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:25.776961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 397/798] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Nov 2 03:22:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:25.782017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a1c4f-2100-4eae-abe3-dded90c08edd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f8ab37c6-2135-4066-b180-bf5b247e8881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:22:25.783624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:25.784570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:22:25.789257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:22:25.789257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:25.789257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:25.789257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 402/799] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:25.792212 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab37c6-2135-4066-b180-bf5b247e8881 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:25.814883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:25.882029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:25.901179 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a1c4f-2100-4eae-abe3-dded90c08edd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:25.940224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85a8f8-2cca-4a90-8ad7-70b4f92d8c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:25.940891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85a8f8-2cca-4a90-8ad7-70b4f92d8c55 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:25.941171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85a8f8-2cca-4a90-8ad7-70b4f92d8c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:25.941440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85a8f8-2cca-4a90-8ad7-70b4f92d8c55 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:25.942122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85a8f8-2cca-4a90-8ad7-70b4f92d8c55 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:25.942427 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85a8f8-2cca-4a90-8ad7-70b4f92d8c55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:25.944339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85a8f8-2cca-4a90-8ad7-70b4f92d8c55 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:25.958354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 398/800] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Nov 2 03:22:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:25.960233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85a8f8-2cca-4a90-8ad7-70b4f92d8c55 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:26.030920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab37c6-2135-4066-b180-bf5b247e8881 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:26.049950 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:26.066390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dc346-5e69-48f7-bd91-643a4876e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:26.066735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85a8f8-2cca-4a90-8ad7-70b4f92d8c55 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:26.066991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc346-5e69-48f7-bd91-643a4876e3bc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.067268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc346-5e69-48f7-bd91-643a4876e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.067538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc346-5e69-48f7-bd91-643a4876e3bc None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.068204 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dc346-5e69-48f7-bd91-643a4876e3bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:26.069073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dc346-5e69-48f7-bd91-643a4876e3bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:26.070507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dc346-5e69-48f7-bd91-643a4876e3bc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:26.081520 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 403/801] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:26.082681 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c9385-c24c-419e-9029-3f92657a2125 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.082967 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c9385-c24c-419e-9029-3f92657a2125 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.083234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c9385-c24c-419e-9029-3f92657a2125 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.085475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 404/802] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:26.091171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6050c-b503-466c-b31e-1da35de0c21c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.091448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6050c-b503-466c-b31e-1da35de0c21c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.092119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6050c-b503-466c-b31e-1da35de0c21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.103249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff9cd0-0939-4ed1-bff4-4e725ad1d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:26.103966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff9cd0-0939-4ed1-bff4-4e725ad1d4ab None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.104251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff9cd0-0939-4ed1-bff4-4e725ad1d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.104548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff9cd0-0939-4ed1-bff4-4e725ad1d4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.116781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff9cd0-0939-4ed1-bff4-4e725ad1d4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:26.117016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a4b6050c-b503-466c-b31e-1da35de0c21c None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:26.118213 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a4b6050c-b503-466c-b31e-1da35de0c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:26.118330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff9cd0-0939-4ed1-bff4-4e725ad1d4ab None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f0ff9cd0-0939-4ed1-bff4-4e725ad1d4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:22:26.134545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:26.135511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:22:26.137203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:22:26.137203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:26.137203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:26.137203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 399/803] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:26.141565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff9cd0-0939-4ed1-bff4-4e725ad1d4ab None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:26.200030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 405/804] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:26.252842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff9cd0-0939-4ed1-bff4-4e725ad1d4ab None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:26.289434 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d8386-6759-4476-a63a-3f115de7a6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:26.290378 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8386-6759-4476-a63a-3f115de7a6cb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.290669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8386-6759-4476-a63a-3f115de7a6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.290941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8386-6759-4476-a63a-3f115de7a6cb None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.291585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d8386-6759-4476-a63a-3f115de7a6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:26.291896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d8386-6759-4476-a63a-3f115de7a6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:26.293273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d8386-6759-4476-a63a-3f115de7a6cb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:26.296231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:26.307772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 400/805] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:26.313012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6050c-b503-466c-b31e-1da35de0c21c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:26.380499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:26.422714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6050c-b503-466c-b31e-1da35de0c21c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:26.457799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06513e-8570-4a77-9f41-d47728c81952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:26.458426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06513e-8570-4a77-9f41-d47728c81952 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.458713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06513e-8570-4a77-9f41-d47728c81952 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.459481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06513e-8570-4a77-9f41-d47728c81952 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.467052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06513e-8570-4a77-9f41-d47728c81952 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:26.468513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06513e-8570-4a77-9f41-d47728c81952 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:26.471311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d8386-6759-4476-a63a-3f115de7a6cb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7d06513e-8570-4a77-9f41-d47728c81952 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:22:26.481496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:26.482635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:26.483583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 406/806] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Nov 2 03:22:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:26.488366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06513e-8570-4a77-9f41-d47728c81952 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:26.571333 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d8386-6759-4476-a63a-3f115de7a6cb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:26.586855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06513e-8570-4a77-9f41-d47728c81952 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:26.604888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3e676-fc5d-4b4d-a838-55f5b8716c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:26.605508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3e676-fc5d-4b4d-a838-55f5b8716c96 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.605785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3e676-fc5d-4b4d-a838-55f5b8716c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.606052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3e676-fc5d-4b4d-a838-55f5b8716c96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.609401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:26.616659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3e676-fc5d-4b4d-a838-55f5b8716c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-05b3e676-fc5d-4b4d-a838-55f5b8716c96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:22:26.621468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:26.622384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:26.623191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 401/807] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:22:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:26.623875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe574c3-3610-403d-b9c8-bff59eeac550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:26.623875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe574c3-3610-403d-b9c8-bff59eeac550 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.623875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe574c3-3610-403d-b9c8-bff59eeac550 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.623875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe574c3-3610-403d-b9c8-bff59eeac550 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.624670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe574c3-3610-403d-b9c8-bff59eeac550 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:26.624926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe574c3-3610-403d-b9c8-bff59eeac550 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:26.626340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe574c3-3610-403d-b9c8-bff59eeac550 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:26.628557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3e676-fc5d-4b4d-a838-55f5b8716c96 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:26.644234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 407/808] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Nov 2 03:22:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:26.650768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe574c3-3610-403d-b9c8-bff59eeac550 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:26.686334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:26.731230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3e676-fc5d-4b4d-a838-55f5b8716c96 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:26.751452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe574c3-3610-403d-b9c8-bff59eeac550 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:26.766007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d706f-3d0f-4284-8365-03091033f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:26.766603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d706f-3d0f-4284-8365-03091033f095 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.766878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d706f-3d0f-4284-8365-03091033f095 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.767146 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d706f-3d0f-4284-8365-03091033f095 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.767800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d706f-3d0f-4284-8365-03091033f095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:26.768095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d706f-3d0f-4284-8365-03091033f095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:26.769479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d706f-3d0f-4284-8365-03091033f095 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:26.778171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 402/809] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:22:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:26.784084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d706f-3d0f-4284-8365-03091033f095 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:26.785659 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951210d-f4cb-449d-a890-b377c2896f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:26.786279 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951210d-f4cb-449d-a890-b377c2896f46 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.786557 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951210d-f4cb-449d-a890-b377c2896f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.786822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951210d-f4cb-449d-a890-b377c2896f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.797244 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951210d-f4cb-449d-a890-b377c2896f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:26.798669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951210d-f4cb-449d-a890-b377c2896f46 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-0951210d-f4cb-449d-a890-b377c2896f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:22:26.812353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:26.813400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:22:26.814287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:22:26.814287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:26.814287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:26.814287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 408/810] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:26.819632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951210d-f4cb-449d-a890-b377c2896f46 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:26.850759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:26.883673 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d706f-3d0f-4284-8365-03091033f095 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:26.900255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:26.917947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1187a2-b20c-4cb7-b2c7-d9cab87e95a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:26.918568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1187a2-b20c-4cb7-b2c7-d9cab87e95a1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.918844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1187a2-b20c-4cb7-b2c7-d9cab87e95a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.919133 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1187a2-b20c-4cb7-b2c7-d9cab87e95a1 None admin] PATH_INFO: `/v3/users/33bb32df029941598ecae9e0c0fbb2cc` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.921037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951210d-f4cb-449d-a890-b377c2896f46 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:26.932393 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1187a2-b20c-4cb7-b2c7-d9cab87e95a1 None admin] RBAC: Authorizing `identity:get_user(user_id=33bb32df029941598ecae9e0c0fbb2cc)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:26.933844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1187a2-b20c-4cb7-b2c7-d9cab87e95a1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:26.935447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 403/811] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:22:26 2022] GET /identity/v3/users/33bb32df029941598ecae9e0c0fbb2cc => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:26.941251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1187a2-b20c-4cb7-b2c7-d9cab87e95a1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:26.954429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5073acf-c4a9-4aaa-b685-268f4838eb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:26.955025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5073acf-c4a9-4aaa-b685-268f4838eb04 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:26.955299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5073acf-c4a9-4aaa-b685-268f4838eb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:26.955570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5073acf-c4a9-4aaa-b685-268f4838eb04 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:26.956201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5073acf-c4a9-4aaa-b685-268f4838eb04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:26.956527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5073acf-c4a9-4aaa-b685-268f4838eb04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:26.957876 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5073acf-c4a9-4aaa-b685-268f4838eb04 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:26.969270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 409/812] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:26.975267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5073acf-c4a9-4aaa-b685-268f4838eb04 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:27.040387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1187a2-b20c-4cb7-b2c7-d9cab87e95a1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:27.065004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:27.075233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5073acf-c4a9-4aaa-b685-268f4838eb04 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:27.078034 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed57b91-81dd-43c1-b5cc-92f1955094e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:27.078666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed57b91-81dd-43c1-b5cc-92f1955094e9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:27.078947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed57b91-81dd-43c1-b5cc-92f1955094e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:27.079219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed57b91-81dd-43c1-b5cc-92f1955094e9 None admin] PATH_INFO: `/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:27.080330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed57b91-81dd-43c1-b5cc-92f1955094e9 None admin] RBAC: Authorizing `identity:get_project(project_id=db34ae3bb6e14b939cf5fceb3c53c4b6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:27.081777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed57b91-81dd-43c1-b5cc-92f1955094e9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:27.083385 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 404/813] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:22:26 2022] GET /identity/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:27.089869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed57b91-81dd-43c1-b5cc-92f1955094e9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:27.111751 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f363c8c-8d19-4e7d-9c4a-14405106d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:27.112384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f363c8c-8d19-4e7d-9c4a-14405106d514 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:27.112724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f363c8c-8d19-4e7d-9c4a-14405106d514 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:27.112977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f363c8c-8d19-4e7d-9c4a-14405106d514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:27.120440 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f363c8c-8d19-4e7d-9c4a-14405106d514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:27.121899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f363c8c-8d19-4e7d-9c4a-14405106d514 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7f363c8c-8d19-4e7d-9c4a-14405106d514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:22:27.133758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:27.134742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:27.135717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:22:27.135717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:22:27.135717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:22:27.135717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:22:27.135717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:22:27.135717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:22:27.135717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:22:27.135717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:27.135717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 410/814] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:22:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:27.141118 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f363c8c-8d19-4e7d-9c4a-14405106d514 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:27.248796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f363c8c-8d19-4e7d-9c4a-14405106d514 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:27.249808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:27.283123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fa7b7-991f-4ecd-bdf4-20fbb162ce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:27.283867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fa7b7-991f-4ecd-bdf4-20fbb162ce0e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:27.284238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fa7b7-991f-4ecd-bdf4-20fbb162ce0e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:27.284734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fa7b7-991f-4ecd-bdf4-20fbb162ce0e None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:27.285412 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fa7b7-991f-4ecd-bdf4-20fbb162ce0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:27.285794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fa7b7-991f-4ecd-bdf4-20fbb162ce0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:27.287462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fa7b7-991f-4ecd-bdf4-20fbb162ce0e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:27.298648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 411/815] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:22:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:27.303981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed57b91-81dd-43c1-b5cc-92f1955094e9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:27.305552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fa7b7-991f-4ecd-bdf4-20fbb162ce0e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:27.320136 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:27.339849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56621284-0d33-474f-a86a-3b8b70f39ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:27.340533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621284-0d33-474f-a86a-3b8b70f39ba6 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:27.340810 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621284-0d33-474f-a86a-3b8b70f39ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:27.341081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621284-0d33-474f-a86a-3b8b70f39ba6 None admin] PATH_INFO: `/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6/users/33bb32df029941598ecae9e0c0fbb2cc/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:27.342955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56621284-0d33-474f-a86a-3b8b70f39ba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=db34ae3bb6e14b939cf5fceb3c53c4b6, user_id=33bb32df029941598ecae9e0c0fbb2cc, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:27.344369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56621284-0d33-474f-a86a-3b8b70f39ba6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:27.357348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 405/816] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:22:27 2022] PUT /identity/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6/users/33bb32df029941598ecae9e0c0fbb2cc/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:22:27.410391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fa7b7-991f-4ecd-bdf4-20fbb162ce0e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:27.448997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58fc7-8cd4-4305-a1c8-6f5e04cf5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:27.449675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58fc7-8cd4-4305-a1c8-6f5e04cf5d0d None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:27.449952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58fc7-8cd4-4305-a1c8-6f5e04cf5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:27.450225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58fc7-8cd4-4305-a1c8-6f5e04cf5d0d None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/35afc6fb66a649e2a9d22ee01cccbc53/roles/f0fe71340dad4d7a9ce41085edc42c99` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:27.452415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58fc7-8cd4-4305-a1c8-6f5e04cf5d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=35afc6fb66a649e2a9d22ee01cccbc53, role_id=f0fe71340dad4d7a9ce41085edc42c99)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:27.453908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58fc7-8cd4-4305-a1c8-6f5e04cf5d0d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:27.468321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 412/817] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:22:27 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/35afc6fb66a649e2a9d22ee01cccbc53/roles/f0fe71340dad4d7a9ce41085edc42c99 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:22:29.483928 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8f6d-00fb-45e4-a4cd-fc11b9812629 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:29.484535 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8f6d-00fb-45e4-a4cd-fc11b9812629 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:29.484535 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8f6d-00fb-45e4-a4cd-fc11b9812629 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:29.485971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 406/818] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:29.491753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e3eee-3ea4-4f78-9fcf-369c63bbb179 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:29.492165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e3eee-3ea4-4f78-9fcf-369c63bbb179 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:29.492415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e3eee-3ea4-4f78-9fcf-369c63bbb179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:29.511739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-538e3eee-3ea4-4f78-9fcf-369c63bbb179 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:29.513003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-538e3eee-3ea4-4f78-9fcf-369c63bbb179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:29.581682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 413/819] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:29.629560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea62e9-b1f3-4c85-9006-07e653654beb None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:29.629846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea62e9-b1f3-4c85-9006-07e653654beb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:29.630121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea62e9-b1f3-4c85-9006-07e653654beb None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:29.632054 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 407/820] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:29.637372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2b87-2ca5-4811-870f-5afe1a4ceca9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:29.637657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2b87-2ca5-4811-870f-5afe1a4ceca9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:29.637930 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2b87-2ca5-4811-870f-5afe1a4ceca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:29.644134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:29.657505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f07a2b87-2ca5-4811-870f-5afe1a4ceca9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:29.658713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f07a2b87-2ca5-4811-870f-5afe1a4ceca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:29.725372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 414/821] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:29.851261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea62e9-b1f3-4c85-9006-07e653654beb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:29.949996 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea62e9-b1f3-4c85-9006-07e653654beb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:29.952241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:29.983329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c0a6-4bc8-41ee-91ac-f689b36c873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:29.983948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c0a6-4bc8-41ee-91ac-f689b36c873f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:29.984226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c0a6-4bc8-41ee-91ac-f689b36c873f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:29.984524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c0a6-4bc8-41ee-91ac-f689b36c873f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:29.995061 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686c0a6-4bc8-41ee-91ac-f689b36c873f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-9686c0a6-4bc8-41ee-91ac-f689b36c873f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:22:30.000144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:30.004807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:30.006081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 408/822] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:22:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:30.007312 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a2b87-2ca5-4811-870f-5afe1a4ceca9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.007451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c0a6-4bc8-41ee-91ac-f689b36c873f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.107846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c0a6-4bc8-41ee-91ac-f689b36c873f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.108047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a2b87-2ca5-4811-870f-5afe1a4ceca9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.137350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:30.141455 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714bbb-06c8-44e9-940f-aa8c521732ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.142085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714bbb-06c8-44e9-940f-aa8c521732ff None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.142367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714bbb-06c8-44e9-940f-aa8c521732ff None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.142561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995a402-ed3d-4d28-a253-86b99d20ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.142680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714bbb-06c8-44e9-940f-aa8c521732ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.143176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995a402-ed3d-4d28-a253-86b99d20ddae None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.143460 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995a402-ed3d-4d28-a253-86b99d20ddae None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.143730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995a402-ed3d-4d28-a253-86b99d20ddae None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.144391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995a402-ed3d-4d28-a253-86b99d20ddae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:30.144737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995a402-ed3d-4d28-a253-86b99d20ddae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:30.146148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995a402-ed3d-4d28-a253-86b99d20ddae None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:30.153843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4714bbb-06c8-44e9-940f-aa8c521732ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:22:30.154945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 415/823] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b4714bbb-06c8-44e9-940f-aa8c521732ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:22:30.158963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:30.160097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:30.161168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 409/824] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:30.163711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995a402-ed3d-4d28-a253-86b99d20ddae None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.166333 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714bbb-06c8-44e9-940f-aa8c521732ff None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.191465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:30.261518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995a402-ed3d-4d28-a253-86b99d20ddae None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.267244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714bbb-06c8-44e9-940f-aa8c521732ff None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.295333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d1f3-6803-4ef8-b5eb-8e1f2ec4282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.295954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d1f3-6803-4ef8-b5eb-8e1f2ec4282e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.296235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d1f3-6803-4ef8-b5eb-8e1f2ec4282e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.296549 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d1f3-6803-4ef8-b5eb-8e1f2ec4282e None admin] PATH_INFO: `/v3/users/33bb32df029941598ecae9e0c0fbb2cc` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.297672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534d1f3-6803-4ef8-b5eb-8e1f2ec4282e None admin] RBAC: Authorizing `identity:get_user(user_id=33bb32df029941598ecae9e0c0fbb2cc)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:30.299100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534d1f3-6803-4ef8-b5eb-8e1f2ec4282e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:30.300696 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 416/825] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/users/33bb32df029941598ecae9e0c0fbb2cc => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:30.301245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745b756-1b92-4ee9-8a2c-34199711921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.301840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745b756-1b92-4ee9-8a2c-34199711921a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.302115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745b756-1b92-4ee9-8a2c-34199711921a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.302383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745b756-1b92-4ee9-8a2c-34199711921a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.303030 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745b756-1b92-4ee9-8a2c-34199711921a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:30.303325 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745b756-1b92-4ee9-8a2c-34199711921a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:30.304677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745b756-1b92-4ee9-8a2c-34199711921a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:30.306469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d1f3-6803-4ef8-b5eb-8e1f2ec4282e None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.313546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 410/826] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:30.319346 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745b756-1b92-4ee9-8a2c-34199711921a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.369066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:30.402942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:30.409068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d1f3-6803-4ef8-b5eb-8e1f2ec4282e None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.418498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745b756-1b92-4ee9-8a2c-34199711921a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.442519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a7d2b-0f7e-4b25-ab7d-2d8a682d8d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.443165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a7d2b-0f7e-4b25-ab7d-2d8a682d8d28 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.443449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a7d2b-0f7e-4b25-ab7d-2d8a682d8d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.443722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a7d2b-0f7e-4b25-ab7d-2d8a682d8d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.451016 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4780-c048-4ead-81cf-2e4d216d759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.451631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4780-c048-4ead-81cf-2e4d216d759c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.451906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4780-c048-4ead-81cf-2e4d216d759c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.452170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4780-c048-4ead-81cf-2e4d216d759c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.463611 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b4780-c048-4ead-81cf-2e4d216d759c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:30.465051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b4780-c048-4ead-81cf-2e4d216d759c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-271b4780-c048-4ead-81cf-2e4d216d759c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:22:30.479869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:30.480923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:22:30.481819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:22:30.481819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:30.481819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:30.481819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 411/827] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:30.486597 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4780-c048-4ead-81cf-2e4d216d759c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.511831 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a7d2b-0f7e-4b25-ab7d-2d8a682d8d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:30.513290 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a7d2b-0f7e-4b25-ab7d-2d8a682d8d28 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:30.571740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:30.591916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4780-c048-4ead-81cf-2e4d216d759c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.612326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 417/828] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 03:22:30.618512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a7d2b-0f7e-4b25-ab7d-2d8a682d8d28 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.627282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9b17d-4215-462b-b128-d408b543ac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.627840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9b17d-4215-462b-b128-d408b543ac9f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.628120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9b17d-4215-462b-b128-d408b543ac9f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.628390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9b17d-4215-462b-b128-d408b543ac9f None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.629060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9b17d-4215-462b-b128-d408b543ac9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:30.629415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9b17d-4215-462b-b128-d408b543ac9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:30.631255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9b17d-4215-462b-b128-d408b543ac9f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:30.638547 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:30.643951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 412/829] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:30.649524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9b17d-4215-462b-b128-d408b543ac9f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.715120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a7d2b-0f7e-4b25-ab7d-2d8a682d8d28 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.749417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9b17d-4215-462b-b128-d408b543ac9f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.749638 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d82fd-eb58-4fa7-8c1e-93e2bfb630e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.750257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d82fd-eb58-4fa7-8c1e-93e2bfb630e2 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.750530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d82fd-eb58-4fa7-8c1e-93e2bfb630e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.750799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d82fd-eb58-4fa7-8c1e-93e2bfb630e2 None admin] PATH_INFO: `/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.751895 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d82fd-eb58-4fa7-8c1e-93e2bfb630e2 None admin] RBAC: Authorizing `identity:get_project(project_id=db34ae3bb6e14b939cf5fceb3c53c4b6)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:30.753335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d82fd-eb58-4fa7-8c1e-93e2bfb630e2 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:30.754933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 418/830] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:30.760958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d82fd-eb58-4fa7-8c1e-93e2bfb630e2 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.784546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91648777-b8a8-443a-8aa7-94687fc7e475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.785195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91648777-b8a8-443a-8aa7-94687fc7e475 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.785484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91648777-b8a8-443a-8aa7-94687fc7e475 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.785745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91648777-b8a8-443a-8aa7-94687fc7e475 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.791162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:30.793357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91648777-b8a8-443a-8aa7-94687fc7e475 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:30.794771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91648777-b8a8-443a-8aa7-94687fc7e475 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-91648777-b8a8-443a-8aa7-94687fc7e475 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:22:30.806726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:30.807869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:30.809287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 413/831] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:30.813499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91648777-b8a8-443a-8aa7-94687fc7e475 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:30.860765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d82fd-eb58-4fa7-8c1e-93e2bfb630e2 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.870405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:30.894684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80091c-8d16-4347-a74c-56d2d20fa697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.895200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80091c-8d16-4347-a74c-56d2d20fa697 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.895468 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80091c-8d16-4347-a74c-56d2d20fa697 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.895734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80091c-8d16-4347-a74c-56d2d20fa697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.896963 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80091c-8d16-4347-a74c-56d2d20fa697 None admin] RBAC: Adding query filter params (role.id=9a4fa7f48c24440cae54bb4ec26b5b49, scope.project.id=db34ae3bb6e14b939cf5fceb3c53c4b6, user.id=33bb32df029941598ecae9e0c0fbb2cc) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:30.897264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80091c-8d16-4347-a74c-56d2d20fa697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:30.898664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80091c-8d16-4347-a74c-56d2d20fa697 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:30.904384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 419/832] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/role_assignments?user.id=33bb32df029941598ecae9e0c0fbb2cc&scope.project.id=db34ae3bb6e14b939cf5fceb3c53c4b6&role.id=9a4fa7f48c24440cae54bb4ec26b5b49 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:30.913624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91648777-b8a8-443a-8aa7-94687fc7e475 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:30.949304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75ca85-3dab-4430-8f2e-b80f0f743c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:30.949912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75ca85-3dab-4430-8f2e-b80f0f743c87 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:30.950188 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75ca85-3dab-4430-8f2e-b80f0f743c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:30.950451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75ca85-3dab-4430-8f2e-b80f0f743c87 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:30.951175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75ca85-3dab-4430-8f2e-b80f0f743c87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:30.951472 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75ca85-3dab-4430-8f2e-b80f0f743c87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:30.953244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75ca85-3dab-4430-8f2e-b80f0f743c87 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:30.973090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 414/833] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:30.979643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80091c-8d16-4347-a74c-56d2d20fa697 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:31.080919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:31.089442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80091c-8d16-4347-a74c-56d2d20fa697 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:31.124620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68730ccd-728f-44a0-84cd-05bf92b551f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:31.125232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68730ccd-728f-44a0-84cd-05bf92b551f7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:31.125529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68730ccd-728f-44a0-84cd-05bf92b551f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:31.125783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68730ccd-728f-44a0-84cd-05bf92b551f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:31.193747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68730ccd-728f-44a0-84cd-05bf92b551f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:31.194695 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68730ccd-728f-44a0-84cd-05bf92b551f7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:31.285333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:31.292992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 420/834] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:22:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 03:22:31.298656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75ca85-3dab-4430-8f2e-b80f0f743c87 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:31.399132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75ca85-3dab-4430-8f2e-b80f0f743c87 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:31.415592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:31.433374 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8735af-510a-483d-b434-68d640219a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:31.433992 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8735af-510a-483d-b434-68d640219a15 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:31.434268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8735af-510a-483d-b434-68d640219a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:31.434534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8735af-510a-483d-b434-68d640219a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:31.444652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8735af-510a-483d-b434-68d640219a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:31.446036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8735af-510a-483d-b434-68d640219a15 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-af8735af-510a-483d-b434-68d640219a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:22:31.460791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:31.461801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:22:31.462677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:22:31.462677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:22:31.462677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:31.464600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 415/835] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:22:31.467435 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68730ccd-728f-44a0-84cd-05bf92b551f7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:31.564599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68730ccd-728f-44a0-84cd-05bf92b551f7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:31.598807 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cade8-f75c-4bc5-886f-ecadb65da688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:31.599998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cade8-f75c-4bc5-886f-ecadb65da688 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:31.600282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cade8-f75c-4bc5-886f-ecadb65da688 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:31.600585 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cade8-f75c-4bc5-886f-ecadb65da688 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:31.601214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cade8-f75c-4bc5-886f-ecadb65da688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:31.601510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cade8-f75c-4bc5-886f-ecadb65da688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:31.602860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cade8-f75c-4bc5-886f-ecadb65da688 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:31.614417 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 421/836] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:31.620428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8735af-510a-483d-b434-68d640219a15 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:31.721642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8735af-510a-483d-b434-68d640219a15 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:31.754301 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681cc96-9d26-49b4-90dd-baf8584d25e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:31.754917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681cc96-9d26-49b4-90dd-baf8584d25e5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:31.755193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681cc96-9d26-49b4-90dd-baf8584d25e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:31.755463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681cc96-9d26-49b4-90dd-baf8584d25e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:31.762312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681cc96-9d26-49b4-90dd-baf8584d25e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:31.763725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681cc96-9d26-49b4-90dd-baf8584d25e5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8681cc96-9d26-49b4-90dd-baf8584d25e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:22:31.775094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:31.775989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:31.776921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:22:31.776921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:22:31.776921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:22:31.776921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:22:31.776921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:22:31.776921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:22:31.776921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:22:31.776921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:31.776921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 416/837] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:31.782155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cade8-f75c-4bc5-886f-ecadb65da688 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:31.839049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:31.883684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cade8-f75c-4bc5-886f-ecadb65da688 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:31.917501 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf728c4f-d4e3-43a2-9de4-0f15abdf72f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:31.917501 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf728c4f-d4e3-43a2-9de4-0f15abdf72f7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:31.917751 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf728c4f-d4e3-43a2-9de4-0f15abdf72f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:31.917980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf728c4f-d4e3-43a2-9de4-0f15abdf72f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:31.918655 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf728c4f-d4e3-43a2-9de4-0f15abdf72f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:31.918984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf728c4f-d4e3-43a2-9de4-0f15abdf72f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:31.920381 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf728c4f-d4e3-43a2-9de4-0f15abdf72f7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:31.932498 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 422/838] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:31.938481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681cc96-9d26-49b4-90dd-baf8584d25e5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:31.966772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:32.039358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681cc96-9d26-49b4-90dd-baf8584d25e5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:32.074522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa50ad-ca54-43c8-8743-2afd7d3b9bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:32.075164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa50ad-ca54-43c8-8743-2afd7d3b9bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:32.076555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa50ad-ca54-43c8-8743-2afd7d3b9bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:32.076555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa50ad-ca54-43c8-8743-2afd7d3b9bc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:32.076555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa50ad-ca54-43c8-8743-2afd7d3b9bc8 None admin] RBAC: Adding query filter params (role.id=f0fe71340dad4d7a9ce41085edc42c99, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=35afc6fb66a649e2a9d22ee01cccbc53) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:32.076834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa50ad-ca54-43c8-8743-2afd7d3b9bc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:32.081381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa50ad-ca54-43c8-8743-2afd7d3b9bc8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:32.084862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 417/839] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:22:31 2022] GET /identity/v3/role_assignments?user.id=35afc6fb66a649e2a9d22ee01cccbc53&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=f0fe71340dad4d7a9ce41085edc42c99 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:33.070185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b442d-7ca9-4d9a-98a2-776701d7a610 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:33.070640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b442d-7ca9-4d9a-98a2-776701d7a610 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:33.070747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b442d-7ca9-4d9a-98a2-776701d7a610 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:33.072054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 423/840] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:33.077634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b521a1-2b3f-4f01-af91-8b968893d8a7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:33.078072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b521a1-2b3f-4f01-af91-8b968893d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:33.078194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b521a1-2b3f-4f01-af91-8b968893d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:33.095929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-90b521a1-2b3f-4f01-af91-8b968893d8a7 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:33.097134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-90b521a1-2b3f-4f01-af91-8b968893d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:33.162356 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 418/841] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:33.427840 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b442d-7ca9-4d9a-98a2-776701d7a610 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:33.526349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b442d-7ca9-4d9a-98a2-776701d7a610 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:33.540254 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:33.560290 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c74a4-ce6d-429b-b667-d154ae694d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:33.560932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c74a4-ce6d-429b-b667-d154ae694d5c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:33.561210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c74a4-ce6d-429b-b667-d154ae694d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:33.561478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c74a4-ce6d-429b-b667-d154ae694d5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:33.562565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c74a4-ce6d-429b-b667-d154ae694d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:33.564018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c74a4-ce6d-429b-b667-d154ae694d5c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:33.565575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 424/842] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:33.571609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b521a1-2b3f-4f01-af91-8b968893d8a7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:33.594435 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:33.667377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b521a1-2b3f-4f01-af91-8b968893d8a7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:33.699608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baea290-ac17-42ae-9b7b-290e9312d171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:33.700142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baea290-ac17-42ae-9b7b-290e9312d171 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:33.700419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baea290-ac17-42ae-9b7b-290e9312d171 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:33.700720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baea290-ac17-42ae-9b7b-290e9312d171 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:33.701354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baea290-ac17-42ae-9b7b-290e9312d171 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:33.702763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baea290-ac17-42ae-9b7b-290e9312d171 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:33.723485 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 419/843] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:22:33 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:35.878928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43830494-efe7-4b1e-8c02-f95e4500b78b None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:35.879483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43830494-efe7-4b1e-8c02-f95e4500b78b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:35.879483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43830494-efe7-4b1e-8c02-f95e4500b78b None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:35.881319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 425/844] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:35.886693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0adfee-4f8d-4676-aa2d-87b8b40f68b4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:35.887119 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0adfee-4f8d-4676-aa2d-87b8b40f68b4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:35.887212 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0adfee-4f8d-4676-aa2d-87b8b40f68b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:35.905450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8b0adfee-4f8d-4676-aa2d-87b8b40f68b4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:35.906612 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b0adfee-4f8d-4676-aa2d-87b8b40f68b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:35.972446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 420/845] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:36.244454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43830494-efe7-4b1e-8c02-f95e4500b78b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:36.341720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43830494-efe7-4b1e-8c02-f95e4500b78b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:36.374200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4f5e-661e-4830-91b2-e3bf26a2e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:36.374803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4f5e-661e-4830-91b2-e3bf26a2e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:36.375080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4f5e-661e-4830-91b2-e3bf26a2e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:36.375349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4f5e-661e-4830-91b2-e3bf26a2e5b0 None admin] PATH_INFO: `/v3/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:36.376733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e4f5e-661e-4830-91b2-e3bf26a2e5b0 None admin] RBAC: Authorizing `identity:get_role(role_id=d36d8bd9f47e4ea8bef7f96d37d55d3c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:36.378085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e4f5e-661e-4830-91b2-e3bf26a2e5b0 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:36.379357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 426/846] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:22:36 2022] GET /identity/v3/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:36.385053 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0adfee-4f8d-4676-aa2d-87b8b40f68b4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:36.394854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:36.481173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0adfee-4f8d-4676-aa2d-87b8b40f68b4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:36.513613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ece94-5788-4ee0-b650-2aeda7d42686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:36.514170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ece94-5788-4ee0-b650-2aeda7d42686 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:36.514449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ece94-5788-4ee0-b650-2aeda7d42686 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:36.514720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ece94-5788-4ee0-b650-2aeda7d42686 None admin] PATH_INFO: `/v3/users/79fa296adeeb4726bc0ecdd3fd21482d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:36.527701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ece94-5788-4ee0-b650-2aeda7d42686 None admin] RBAC: Authorizing `identity:get_user(user_id=79fa296adeeb4726bc0ecdd3fd21482d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:36.529147 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ece94-5788-4ee0-b650-2aeda7d42686 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:36.530690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 421/847] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:22:36 2022] GET /identity/v3/users/79fa296adeeb4726bc0ecdd3fd21482d => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:36.536308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4f5e-661e-4830-91b2-e3bf26a2e5b0 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:36.584961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:36.632737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4f5e-661e-4830-91b2-e3bf26a2e5b0 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:36.664915 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e8df0-80ea-49bb-8c00-d2b04a262c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:36.665529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e8df0-80ea-49bb-8c00-d2b04a262c2d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:36.665808 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e8df0-80ea-49bb-8c00-d2b04a262c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:36.666076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e8df0-80ea-49bb-8c00-d2b04a262c2d None admin] PATH_INFO: `/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:36.667170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e8df0-80ea-49bb-8c00-d2b04a262c2d None admin] RBAC: Authorizing `identity:get_project(project_id=db34ae3bb6e14b939cf5fceb3c53c4b6)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:36.668628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e8df0-80ea-49bb-8c00-d2b04a262c2d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:36.670205 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 427/848] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:22:36 2022] GET /identity/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:36.675994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ece94-5788-4ee0-b650-2aeda7d42686 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:36.740219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:36.773974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ece94-5788-4ee0-b650-2aeda7d42686 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:36.805681 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66d5da-3989-4bc5-ab1f-33169f0dfb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:36.806320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66d5da-3989-4bc5-ab1f-33169f0dfb68 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:36.806595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66d5da-3989-4bc5-ab1f-33169f0dfb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:36.806868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66d5da-3989-4bc5-ab1f-33169f0dfb68 None admin] PATH_INFO: `/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6/users/79fa296adeeb4726bc0ecdd3fd21482d/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:36.808968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66d5da-3989-4bc5-ab1f-33169f0dfb68 None admin] RBAC: Authorizing `identity:create_grant(project_id=db34ae3bb6e14b939cf5fceb3c53c4b6, user_id=79fa296adeeb4726bc0ecdd3fd21482d, role_id=d36d8bd9f47e4ea8bef7f96d37d55d3c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:36.810368 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66d5da-3989-4bc5-ab1f-33169f0dfb68 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:36.823167 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 422/849] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:22:36 2022] PUT /identity/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6/users/79fa296adeeb4726bc0ecdd3fd21482d/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:22:38.925335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cd473-7793-4a40-8732-f8ac89329d0d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:38.925866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cd473-7793-4a40-8732-f8ac89329d0d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:38.925866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cd473-7793-4a40-8732-f8ac89329d0d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:38.927272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 428/850] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:22:38.932513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3e0b6-2edb-44bf-bd6a-62239f3c09b4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:38.932914 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3e0b6-2edb-44bf-bd6a-62239f3c09b4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:38.933065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3e0b6-2edb-44bf-bd6a-62239f3c09b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:38.951105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ffe3e0b6-2edb-44bf-bd6a-62239f3c09b4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:38.952290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ffe3e0b6-2edb-44bf-bd6a-62239f3c09b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:39.016203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 423/851] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:22:39.283432 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cd473-7793-4a40-8732-f8ac89329d0d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:39.382699 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cd473-7793-4a40-8732-f8ac89329d0d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:39.399592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:39.416999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b88d8-d455-428c-8c12-0c8657d93cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:39.417611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b88d8-d455-428c-8c12-0c8657d93cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:39.417890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b88d8-d455-428c-8c12-0c8657d93cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:39.418162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b88d8-d455-428c-8c12-0c8657d93cd7 None admin] PATH_INFO: `/v3/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:39.419532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b88d8-d455-428c-8c12-0c8657d93cd7 None admin] RBAC: Authorizing `identity:get_role(role_id=d36d8bd9f47e4ea8bef7f96d37d55d3c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:39.420932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b88d8-d455-428c-8c12-0c8657d93cd7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:39.422211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 429/852] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:22:39 2022] GET /identity/v3/roles/d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:39.427985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3e0b6-2edb-44bf-bd6a-62239f3c09b4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:39.482122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:39.525552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3e0b6-2edb-44bf-bd6a-62239f3c09b4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:39.557903 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c46a22-e2e8-45f0-a2ca-e023237c4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:39.558457 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c46a22-e2e8-45f0-a2ca-e023237c4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:39.558735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c46a22-e2e8-45f0-a2ca-e023237c4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:39.559002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c46a22-e2e8-45f0-a2ca-e023237c4aa0 None admin] PATH_INFO: `/v3/users/79fa296adeeb4726bc0ecdd3fd21482d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:39.560086 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c46a22-e2e8-45f0-a2ca-e023237c4aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=79fa296adeeb4726bc0ecdd3fd21482d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:39.561517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c46a22-e2e8-45f0-a2ca-e023237c4aa0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:39.563041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 424/853] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:22:39 2022] GET /identity/v3/users/79fa296adeeb4726bc0ecdd3fd21482d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:39.569491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b88d8-d455-428c-8c12-0c8657d93cd7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:39.665439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b88d8-d455-428c-8c12-0c8657d93cd7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:39.697698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66319c16-a952-406a-bf63-b5c43cf9ddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:39.698286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319c16-a952-406a-bf63-b5c43cf9ddb1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:39.698570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319c16-a952-406a-bf63-b5c43cf9ddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:39.698841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319c16-a952-406a-bf63-b5c43cf9ddb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:39.756001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:39.769093 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66319c16-a952-406a-bf63-b5c43cf9ddb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:39.770525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66319c16-a952-406a-bf63-b5c43cf9ddb1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:39.869886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 430/854] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:22:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 03:22:39.875664 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c46a22-e2e8-45f0-a2ca-e023237c4aa0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:39.970757 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c46a22-e2e8-45f0-a2ca-e023237c4aa0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:39.995322 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:40.006737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2ddfe-d967-423d-8496-29888e2af195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:40.007347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ddfe-d967-423d-8496-29888e2af195 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:40.007626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ddfe-d967-423d-8496-29888e2af195 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:40.007895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ddfe-d967-423d-8496-29888e2af195 None admin] PATH_INFO: `/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:40.009019 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2ddfe-d967-423d-8496-29888e2af195 None admin] RBAC: Authorizing `identity:get_project(project_id=db34ae3bb6e14b939cf5fceb3c53c4b6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:40.010422 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2ddfe-d967-423d-8496-29888e2af195 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:40.011999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 425/855] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:22:39 2022] GET /identity/v3/projects/db34ae3bb6e14b939cf5fceb3c53c4b6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:40.018148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66319c16-a952-406a-bf63-b5c43cf9ddb1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:40.101966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:40.117675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66319c16-a952-406a-bf63-b5c43cf9ddb1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:40.150625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366ab3-536f-4be6-911c-c481243bb2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:40.151161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366ab3-536f-4be6-911c-c481243bb2eb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:40.151441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366ab3-536f-4be6-911c-c481243bb2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:40.151714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366ab3-536f-4be6-911c-c481243bb2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:40.152426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa366ab3-536f-4be6-911c-c481243bb2eb None admin] RBAC: Adding query filter params (role.id=d36d8bd9f47e4ea8bef7f96d37d55d3c, scope.project.id=db34ae3bb6e14b939cf5fceb3c53c4b6, user.id=79fa296adeeb4726bc0ecdd3fd21482d) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:40.152766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa366ab3-536f-4be6-911c-c481243bb2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:40.154192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa366ab3-536f-4be6-911c-c481243bb2eb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:40.159752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 431/856] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:22:40 2022] GET /identity/v3/role_assignments?user.id=79fa296adeeb4726bc0ecdd3fd21482d&scope.project.id=db34ae3bb6e14b939cf5fceb3c53c4b6&role.id=d36d8bd9f47e4ea8bef7f96d37d55d3c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:42.276081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee596e-ff15-483d-8ab8-68372a4ed71e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:42.276684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee596e-ff15-483d-8ab8-68372a4ed71e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:42.276684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee596e-ff15-483d-8ab8-68372a4ed71e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:42.277977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 426/857] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:42.283168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136658e-8cd2-410f-aff4-fb196e63baef None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:42.283549 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136658e-8cd2-410f-aff4-fb196e63baef None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:42.283715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136658e-8cd2-410f-aff4-fb196e63baef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:42.301813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1136658e-8cd2-410f-aff4-fb196e63baef None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:42.302951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1136658e-8cd2-410f-aff4-fb196e63baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:42.366749 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 432/858] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:42.632628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee596e-ff15-483d-8ab8-68372a4ed71e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:42.733474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee596e-ff15-483d-8ab8-68372a4ed71e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:42.767231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfef6a-ff10-498e-a994-27edca0d1591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:42.767845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfef6a-ff10-498e-a994-27edca0d1591 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:42.768124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfef6a-ff10-498e-a994-27edca0d1591 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:42.768394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfef6a-ff10-498e-a994-27edca0d1591 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:42.769523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfef6a-ff10-498e-a994-27edca0d1591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:42.771452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfef6a-ff10-498e-a994-27edca0d1591 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:42.773008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 427/859] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:42.778802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136658e-8cd2-410f-aff4-fb196e63baef None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:42.855477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:42.875376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136658e-8cd2-410f-aff4-fb196e63baef None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:42.909941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695beacb-ec9a-4575-8df9-4d56933024da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:42.910480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695beacb-ec9a-4575-8df9-4d56933024da None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:42.910755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695beacb-ec9a-4575-8df9-4d56933024da None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:42.911022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695beacb-ec9a-4575-8df9-4d56933024da None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:42.912251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695beacb-ec9a-4575-8df9-4d56933024da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:42.913693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695beacb-ec9a-4575-8df9-4d56933024da None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:42.938596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 433/860] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:22:42 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:45.076541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29cc7f-9903-43c4-a5a6-941c8297e834 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:45.077065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29cc7f-9903-43c4-a5a6-941c8297e834 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:45.077065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29cc7f-9903-43c4-a5a6-941c8297e834 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:45.078401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 428/861] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:45.084420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db6dde-4243-4024-834b-d7857ed48fd1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:45.084863 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db6dde-4243-4024-834b-d7857ed48fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:45.084992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db6dde-4243-4024-834b-d7857ed48fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:45.103206 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-92db6dde-4243-4024-834b-d7857ed48fd1 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:45.104368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-92db6dde-4243-4024-834b-d7857ed48fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:45.171952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 434/862] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:45.436729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29cc7f-9903-43c4-a5a6-941c8297e834 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:45.494494 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:45.535981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29cc7f-9903-43c4-a5a6-941c8297e834 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:45.568561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e272-794b-4747-a067-c2f02e638a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:45.569179 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e272-794b-4747-a067-c2f02e638a01 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:45.569461 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e272-794b-4747-a067-c2f02e638a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:45.569734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e272-794b-4747-a067-c2f02e638a01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:45.570837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3e272-794b-4747-a067-c2f02e638a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:45.572244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3e272-794b-4747-a067-c2f02e638a01 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:45.573811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 429/863] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:22:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:45.579490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db6dde-4243-4024-834b-d7857ed48fd1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:45.638444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:45.677080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db6dde-4243-4024-834b-d7857ed48fd1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:45.710387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb42ee4-a87a-49a5-9089-aefe9af9cace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:45.710974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42ee4-a87a-49a5-9089-aefe9af9cace None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:45.711254 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42ee4-a87a-49a5-9089-aefe9af9cace None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:45.711525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42ee4-a87a-49a5-9089-aefe9af9cace None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:45.712168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb42ee4-a87a-49a5-9089-aefe9af9cace None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:45.713618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb42ee4-a87a-49a5-9089-aefe9af9cace None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:45.734491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 435/864] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:22:45 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:22:47.895207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00190c90-fa23-4c2a-8f31-36dfedbdfc56 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:47.896038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00190c90-fa23-4c2a-8f31-36dfedbdfc56 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:47.896268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00190c90-fa23-4c2a-8f31-36dfedbdfc56 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:47.897662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 430/865] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:47.902943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed19f58-e2ee-4ef9-944a-421c042cc105 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:47.903361 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed19f58-e2ee-4ef9-944a-421c042cc105 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:47.903481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed19f58-e2ee-4ef9-944a-421c042cc105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:47.921713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2ed19f58-e2ee-4ef9-944a-421c042cc105 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:47.922895 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2ed19f58-e2ee-4ef9-944a-421c042cc105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:47.986662 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 436/866] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:48.259476 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00190c90-fa23-4c2a-8f31-36dfedbdfc56 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:48.357464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00190c90-fa23-4c2a-8f31-36dfedbdfc56 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:48.382412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:48.390312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78152fe-fc14-4c6a-9892-440f899b69e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:48.390923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78152fe-fc14-4c6a-9892-440f899b69e3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:48.391198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78152fe-fc14-4c6a-9892-440f899b69e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:48.391464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78152fe-fc14-4c6a-9892-440f899b69e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:48.401680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78152fe-fc14-4c6a-9892-440f899b69e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f78152fe-fc14-4c6a-9892-440f899b69e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:22:48.406409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:48.407483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:22:48.408701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 431/867] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:22:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:48.414084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed19f58-e2ee-4ef9-944a-421c042cc105 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:48.460902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:48.511920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed19f58-e2ee-4ef9-944a-421c042cc105 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:48.544782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5bcdb-c996-441a-ace2-ae35ccd3a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:48.545374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5bcdb-c996-441a-ace2-ae35ccd3a039 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:48.545652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5bcdb-c996-441a-ace2-ae35ccd3a039 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:48.545922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5bcdb-c996-441a-ace2-ae35ccd3a039 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:48.546582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5bcdb-c996-441a-ace2-ae35ccd3a039 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:48.546884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5bcdb-c996-441a-ace2-ae35ccd3a039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:48.548242 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5bcdb-c996-441a-ace2-ae35ccd3a039 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:48.556183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 437/868] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:22:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:48.561920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78152fe-fc14-4c6a-9892-440f899b69e3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:48.658487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78152fe-fc14-4c6a-9892-440f899b69e3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:48.690321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913c868-f93f-4a35-8971-78cb4144f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:48.690935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913c868-f93f-4a35-8971-78cb4144f012 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:48.691214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913c868-f93f-4a35-8971-78cb4144f012 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:48.691487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913c868-f93f-4a35-8971-78cb4144f012 None admin] PATH_INFO: `/v3/users/c774dd777b244111b530f8e40cab4c96` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:48.704946 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913c868-f93f-4a35-8971-78cb4144f012 None admin] RBAC: Authorizing `identity:get_user(user_id=c774dd777b244111b530f8e40cab4c96)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:48.706358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913c868-f93f-4a35-8971-78cb4144f012 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:48.708422 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 432/869] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:22:48 2022] GET /identity/v3/users/c774dd777b244111b530f8e40cab4c96 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:48.714054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5bcdb-c996-441a-ace2-ae35ccd3a039 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:48.811293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5bcdb-c996-441a-ace2-ae35ccd3a039 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:48.821631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:48.845265 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e79a6a-4cfc-422a-abe5-f514c7a6611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:48.845881 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79a6a-4cfc-422a-abe5-f514c7a6611c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:48.846162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79a6a-4cfc-422a-abe5-f514c7a6611c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:48.846436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79a6a-4cfc-422a-abe5-f514c7a6611c None admin] PATH_INFO: `/v3/projects/9958dc5dcbc84e658d666ed9873ebc2e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:48.847535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e79a6a-4cfc-422a-abe5-f514c7a6611c None admin] RBAC: Authorizing `identity:get_project(project_id=9958dc5dcbc84e658d666ed9873ebc2e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:48.849235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e79a6a-4cfc-422a-abe5-f514c7a6611c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:48.850826 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 438/870] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:22:48 2022] GET /identity/v3/projects/9958dc5dcbc84e658d666ed9873ebc2e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:48.856761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913c868-f93f-4a35-8971-78cb4144f012 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:48.903312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:48.955428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913c868-f93f-4a35-8971-78cb4144f012 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:48.988267 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cc083-ea39-4203-9de3-af55a9e699c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:48.988930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cc083-ea39-4203-9de3-af55a9e699c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:48.989706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cc083-ea39-4203-9de3-af55a9e699c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:48.989975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cc083-ea39-4203-9de3-af55a9e699c7 None admin] PATH_INFO: `/v3/projects/9958dc5dcbc84e658d666ed9873ebc2e/users/c774dd777b244111b530f8e40cab4c96/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:48.991813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cc083-ea39-4203-9de3-af55a9e699c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9958dc5dcbc84e658d666ed9873ebc2e, user_id=c774dd777b244111b530f8e40cab4c96, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:48.993237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cc083-ea39-4203-9de3-af55a9e699c7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:49.006442 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 433/871] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:22:48 2022] PUT /identity/v3/projects/9958dc5dcbc84e658d666ed9873ebc2e/users/c774dd777b244111b530f8e40cab4c96/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:22:51.106338 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d5bf8-16ea-4ab6-8803-677b518e88c5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:51.106834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d5bf8-16ea-4ab6-8803-677b518e88c5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:51.106946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d5bf8-16ea-4ab6-8803-677b518e88c5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:51.108207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 439/872] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:51.113682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80fa2-d341-4729-9560-55e9f7724495 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:51.114679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80fa2-d341-4729-9560-55e9f7724495 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:51.114767 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80fa2-d341-4729-9560-55e9f7724495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:51.132380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-96f80fa2-d341-4729-9560-55e9f7724495 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:51.133586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-96f80fa2-d341-4729-9560-55e9f7724495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:51.198022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 434/873] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:51.465642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d5bf8-16ea-4ab6-8803-677b518e88c5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:51.565016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d5bf8-16ea-4ab6-8803-677b518e88c5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:51.598694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495bb36-dd1c-4b34-a7b5-677f05b7fa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:51.599399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495bb36-dd1c-4b34-a7b5-677f05b7fa19 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:51.599680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495bb36-dd1c-4b34-a7b5-677f05b7fa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:51.599950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495bb36-dd1c-4b34-a7b5-677f05b7fa19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:51.609714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495bb36-dd1c-4b34-a7b5-677f05b7fa19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-b495bb36-dd1c-4b34-a7b5-677f05b7fa19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:22:51.614889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:22:51.615969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:22:51.617006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 440/874] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:22:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:22:51.621891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f80fa2-d341-4729-9560-55e9f7724495 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:51.655357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:51.718939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f80fa2-d341-4729-9560-55e9f7724495 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:51.754257 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637aedfe-44cf-4580-8f84-a7bc5efe6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:51.755834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637aedfe-44cf-4580-8f84-a7bc5efe6e78 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:51.756114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637aedfe-44cf-4580-8f84-a7bc5efe6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:51.756391 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637aedfe-44cf-4580-8f84-a7bc5efe6e78 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:51.757081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637aedfe-44cf-4580-8f84-a7bc5efe6e78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:51.757389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637aedfe-44cf-4580-8f84-a7bc5efe6e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:51.758859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637aedfe-44cf-4580-8f84-a7bc5efe6e78 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:51.766923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 435/875] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:22:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:22:51.773509 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495bb36-dd1c-4b34-a7b5-677f05b7fa19 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:51.813545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:51.872992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495bb36-dd1c-4b34-a7b5-677f05b7fa19 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:51.905669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c3d93-5f3d-424b-a21e-6b7633acc8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:51.906278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c3d93-5f3d-424b-a21e-6b7633acc8dc None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:51.906555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c3d93-5f3d-424b-a21e-6b7633acc8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:51.906824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c3d93-5f3d-424b-a21e-6b7633acc8dc None admin] PATH_INFO: `/v3/users/c774dd777b244111b530f8e40cab4c96` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:51.907912 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c3d93-5f3d-424b-a21e-6b7633acc8dc None admin] RBAC: Authorizing `identity:get_user(user_id=c774dd777b244111b530f8e40cab4c96)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:51.909351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c3d93-5f3d-424b-a21e-6b7633acc8dc None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:51.910967 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 441/876] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:22:51 2022] GET /identity/v3/users/c774dd777b244111b530f8e40cab4c96 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:51.916868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637aedfe-44cf-4580-8f84-a7bc5efe6e78 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:52.009067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:52.012730 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637aedfe-44cf-4580-8f84-a7bc5efe6e78 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:52.044744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd39c6-7323-412f-8612-8779bc42aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:52.045342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd39c6-7323-412f-8612-8779bc42aa61 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:52.045619 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd39c6-7323-412f-8612-8779bc42aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:52.045888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd39c6-7323-412f-8612-8779bc42aa61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:52.110718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd39c6-7323-412f-8612-8779bc42aa61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:52.112127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd39c6-7323-412f-8612-8779bc42aa61 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:52.201865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:52.206344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 436/877] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:22:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 03:22:52.212070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c3d93-5f3d-424b-a21e-6b7633acc8dc None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:52.309858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c3d93-5f3d-424b-a21e-6b7633acc8dc None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:52.316531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:52.343373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c38384-dad1-42b6-b37f-9a676d41a215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:52.343987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c38384-dad1-42b6-b37f-9a676d41a215 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:52.344270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c38384-dad1-42b6-b37f-9a676d41a215 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:52.344575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c38384-dad1-42b6-b37f-9a676d41a215 None admin] PATH_INFO: `/v3/projects/9958dc5dcbc84e658d666ed9873ebc2e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:52.345677 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c38384-dad1-42b6-b37f-9a676d41a215 None admin] RBAC: Authorizing `identity:get_project(project_id=9958dc5dcbc84e658d666ed9873ebc2e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:52.347103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c38384-dad1-42b6-b37f-9a676d41a215 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:52.349454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 442/878] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:22:52 2022] GET /identity/v3/projects/9958dc5dcbc84e658d666ed9873ebc2e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:52.355432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd39c6-7323-412f-8612-8779bc42aa61 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:52.450623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd39c6-7323-412f-8612-8779bc42aa61 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:52.482883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bf2fb-82b9-48ba-9a79-7c4d3d4ed2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:52.483466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bf2fb-82b9-48ba-9a79-7c4d3d4ed2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:52.483744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bf2fb-82b9-48ba-9a79-7c4d3d4ed2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:52.484015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bf2fb-82b9-48ba-9a79-7c4d3d4ed2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:52.484750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bf2fb-82b9-48ba-9a79-7c4d3d4ed2a3 None admin] RBAC: Adding query filter params (role.id=9a4fa7f48c24440cae54bb4ec26b5b49, scope.project.id=9958dc5dcbc84e658d666ed9873ebc2e, user.id=c774dd777b244111b530f8e40cab4c96) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:22:52.485057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bf2fb-82b9-48ba-9a79-7c4d3d4ed2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:52.486458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bf2fb-82b9-48ba-9a79-7c4d3d4ed2a3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:52.492843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 437/879] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:22:52 2022] GET /identity/v3/role_assignments?user.id=c774dd777b244111b530f8e40cab4c96&scope.project.id=9958dc5dcbc84e658d666ed9873ebc2e&role.id=9a4fa7f48c24440cae54bb4ec26b5b49 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:54.639985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910326f-0520-44de-878e-db60774914a5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:54.640544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910326f-0520-44de-878e-db60774914a5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:54.640544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910326f-0520-44de-878e-db60774914a5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:54.641902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 443/880] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:54.647722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419e97a-b2e9-4d25-a022-9b535a6535f9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:54.648148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419e97a-b2e9-4d25-a022-9b535a6535f9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:54.648241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419e97a-b2e9-4d25-a022-9b535a6535f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:54.665915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f419e97a-b2e9-4d25-a022-9b535a6535f9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:54.667084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f419e97a-b2e9-4d25-a022-9b535a6535f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:54.720332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:54.730583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 438/881] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:54.996399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910326f-0520-44de-878e-db60774914a5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:55.094087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910326f-0520-44de-878e-db60774914a5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:55.126639 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabfe52-8cc6-43d4-93cc-a69aea99f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:55.127228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabfe52-8cc6-43d4-93cc-a69aea99f09f None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:55.127506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabfe52-8cc6-43d4-93cc-a69aea99f09f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:55.127771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabfe52-8cc6-43d4-93cc-a69aea99f09f None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:55.128429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabfe52-8cc6-43d4-93cc-a69aea99f09f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:55.129879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabfe52-8cc6-43d4-93cc-a69aea99f09f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:55.145446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 444/882] 10.222.0.20 () {60 vars in 1138 bytes} [Wed Nov 2 03:22:54 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:22:57.290047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa381318-f509-46d9-978f-dcc0f600e954 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:57.290571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa381318-f509-46d9-978f-dcc0f600e954 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:57.290571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa381318-f509-46d9-978f-dcc0f600e954 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:57.291910 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 439/883] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:22:57.297145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c440c9-dfdc-4390-9468-50f80213b794 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:57.297526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c440c9-dfdc-4390-9468-50f80213b794 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:57.297650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c440c9-dfdc-4390-9468-50f80213b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:57.315512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-35c440c9-dfdc-4390-9468-50f80213b794 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:22:57.316794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-35c440c9-dfdc-4390-9468-50f80213b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:22:57.342974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:22:57.382769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 445/884] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:22:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:22:57.651252 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa381318-f509-46d9-978f-dcc0f600e954 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:57.749155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa381318-f509-46d9-978f-dcc0f600e954 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:57.781279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e94897-2943-4449-ab11-0069b4b4f251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:57.781893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e94897-2943-4449-ab11-0069b4b4f251 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:57.782174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e94897-2943-4449-ab11-0069b4b4f251 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:57.782447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e94897-2943-4449-ab11-0069b4b4f251 None admin] PATH_INFO: `/v3/domains/1b775e0b99cf46cdbc1394ed45debfec` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:57.793034 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e94897-2943-4449-ab11-0069b4b4f251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1b775e0b99cf46cdbc1394ed45debfec)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:57.794451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e94897-2943-4449-ab11-0069b4b4f251 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:57.795987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 440/885] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Nov 2 03:22:57 2022] GET /identity/v3/domains/1b775e0b99cf46cdbc1394ed45debfec => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:22:57.802480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c440c9-dfdc-4390-9468-50f80213b794 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:22:57.897813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c440c9-dfdc-4390-9468-50f80213b794 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:22:57.930235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad886d7-e540-4efb-a93d-891029378c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:22:57.930763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad886d7-e540-4efb-a93d-891029378c28 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:22:57.931039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad886d7-e540-4efb-a93d-891029378c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:22:57.931304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad886d7-e540-4efb-a93d-891029378c28 None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:22:57.931945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad886d7-e540-4efb-a93d-891029378c28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:22:57.933456 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad886d7-e540-4efb-a93d-891029378c28 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:22:57.960538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 446/886] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:22:57 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:23:00.119895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef0d0-7424-46c9-bdd5-646cff7aa847 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:00.120448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef0d0-7424-46c9-bdd5-646cff7aa847 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:00.120448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef0d0-7424-46c9-bdd5-646cff7aa847 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:00.121779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 441/887] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:23:00.127019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825bfb6-1290-4dfc-b94b-2da18111ef6e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:00.127472 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825bfb6-1290-4dfc-b94b-2da18111ef6e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:00.127587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825bfb6-1290-4dfc-b94b-2da18111ef6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:00.146257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d825bfb6-1290-4dfc-b94b-2da18111ef6e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:23:00.147425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d825bfb6-1290-4dfc-b94b-2da18111ef6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:23:00.157898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:00.212859 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 447/888] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:23:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:23:00.480354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ef0d0-7424-46c9-bdd5-646cff7aa847 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:00.532687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:00.578612 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ef0d0-7424-46c9-bdd5-646cff7aa847 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:00.610919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811f9e1-fb4e-4b05-9bf0-93c72edf7080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:00.611526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811f9e1-fb4e-4b05-9bf0-93c72edf7080 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:00.611801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811f9e1-fb4e-4b05-9bf0-93c72edf7080 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:00.612067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811f9e1-fb4e-4b05-9bf0-93c72edf7080 None admin] PATH_INFO: `/v3/domains/1b775e0b99cf46cdbc1394ed45debfec` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:00.613462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811f9e1-fb4e-4b05-9bf0-93c72edf7080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1b775e0b99cf46cdbc1394ed45debfec)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:00.614865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811f9e1-fb4e-4b05-9bf0-93c72edf7080 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:00.616374 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 442/889] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Nov 2 03:23:00 2022] GET /identity/v3/domains/1b775e0b99cf46cdbc1394ed45debfec => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:23:00.622114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825bfb6-1290-4dfc-b94b-2da18111ef6e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:00.717717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825bfb6-1290-4dfc-b94b-2da18111ef6e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:00.751725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1dfcb-3bfc-4862-9228-d079633d2765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:00.752264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1dfcb-3bfc-4862-9228-d079633d2765 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:00.752571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1dfcb-3bfc-4862-9228-d079633d2765 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:00.752846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1dfcb-3bfc-4862-9228-d079633d2765 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:00.753496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1dfcb-3bfc-4862-9228-d079633d2765 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:00.755399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1dfcb-3bfc-4862-9228-d079633d2765 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:00.776170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 448/890] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:23:00 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:23:02.931544 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e4d6c-9fa2-4719-88b4-977203bbdd11 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:02.932106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e4d6c-9fa2-4719-88b4-977203bbdd11 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:02.932106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e4d6c-9fa2-4719-88b4-977203bbdd11 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:02.933449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 443/891] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:23:02.938522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac47e5-8bf9-43e3-9f69-97e12d107986 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:02.938954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac47e5-8bf9-43e3-9f69-97e12d107986 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:02.939067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac47e5-8bf9-43e3-9f69-97e12d107986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:02.945783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:02.959248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-28ac47e5-8bf9-43e3-9f69-97e12d107986 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:23:02.960411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-28ac47e5-8bf9-43e3-9f69-97e12d107986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:23:03.024302 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 449/892] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:23:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:23:03.302143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e4d6c-9fa2-4719-88b4-977203bbdd11 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:03.400467 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e4d6c-9fa2-4719-88b4-977203bbdd11 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:03.419581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:03.433845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c1bd4-c23f-4664-bcd8-bdf3bb612f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:03.434461 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1bd4-c23f-4664-bcd8-bdf3bb612f34 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:03.434740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1bd4-c23f-4664-bcd8-bdf3bb612f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:03.435009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1bd4-c23f-4664-bcd8-bdf3bb612f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:03.445697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c1bd4-c23f-4664-bcd8-bdf3bb612f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-320c1bd4-c23f-4664-bcd8-bdf3bb612f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:23:03.450487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:23:03.451618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:23:03.452693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 444/893] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:23:03.457559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac47e5-8bf9-43e3-9f69-97e12d107986 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:03.553656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac47e5-8bf9-43e3-9f69-97e12d107986 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:03.580873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:03.586581 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774430-d1ab-4181-ad6c-0e9907caa772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:03.587176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774430-d1ab-4181-ad6c-0e9907caa772 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:03.587452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774430-d1ab-4181-ad6c-0e9907caa772 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:03.587721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774430-d1ab-4181-ad6c-0e9907caa772 None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:03.588369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774430-d1ab-4181-ad6c-0e9907caa772 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:23:03.588697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774430-d1ab-4181-ad6c-0e9907caa772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:03.590052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774430-d1ab-4181-ad6c-0e9907caa772 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:03.598385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 450/894] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:23:03.604198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c1bd4-c23f-4664-bcd8-bdf3bb612f34 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:03.699406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c1bd4-c23f-4664-bcd8-bdf3bb612f34 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:03.731932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15a451-265e-4917-8e1f-bbf5032e5307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:03.732564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a451-265e-4917-8e1f-bbf5032e5307 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:03.732842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a451-265e-4917-8e1f-bbf5032e5307 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:03.733111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a451-265e-4917-8e1f-bbf5032e5307 None admin] PATH_INFO: `/v3/users/3189c2fd80734a8d925a3de2d93eab32` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:03.745909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15a451-265e-4917-8e1f-bbf5032e5307 None admin] RBAC: Authorizing `identity:get_user(user_id=3189c2fd80734a8d925a3de2d93eab32)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:03.747321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15a451-265e-4917-8e1f-bbf5032e5307 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:03.748892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 445/895] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:23:03 2022] GET /identity/v3/users/3189c2fd80734a8d925a3de2d93eab32 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:23:03.755143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774430-d1ab-4181-ad6c-0e9907caa772 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:03.851007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774430-d1ab-4181-ad6c-0e9907caa772 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:03.884644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8deecd-e0f7-4568-a1a0-090d7db0d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:03.885265 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8deecd-e0f7-4568-a1a0-090d7db0d2ff None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:03.885547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8deecd-e0f7-4568-a1a0-090d7db0d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:03.885822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8deecd-e0f7-4568-a1a0-090d7db0d2ff None admin] PATH_INFO: `/v3/projects/67b4205afa5c48e0966bf40c316796a7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:03.886923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8deecd-e0f7-4568-a1a0-090d7db0d2ff None admin] RBAC: Authorizing `identity:get_project(project_id=67b4205afa5c48e0966bf40c316796a7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:03.888374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8deecd-e0f7-4568-a1a0-090d7db0d2ff None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:03.890014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 451/896] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:23:03 2022] GET /identity/v3/projects/67b4205afa5c48e0966bf40c316796a7 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:23:03.896083 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15a451-265e-4917-8e1f-bbf5032e5307 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:03.934432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:03.993939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15a451-265e-4917-8e1f-bbf5032e5307 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:04.026683 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eac02d-305d-4d0f-a92a-c1c1727da37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:04.027328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eac02d-305d-4d0f-a92a-c1c1727da37b None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:04.027608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eac02d-305d-4d0f-a92a-c1c1727da37b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:04.027881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eac02d-305d-4d0f-a92a-c1c1727da37b None admin] PATH_INFO: `/v3/projects/67b4205afa5c48e0966bf40c316796a7/users/3189c2fd80734a8d925a3de2d93eab32/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:04.029779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eac02d-305d-4d0f-a92a-c1c1727da37b None admin] RBAC: Authorizing `identity:create_grant(project_id=67b4205afa5c48e0966bf40c316796a7, user_id=3189c2fd80734a8d925a3de2d93eab32, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:04.031193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eac02d-305d-4d0f-a92a-c1c1727da37b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:04.044224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 446/897] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:23:03 2022] PUT /identity/v3/projects/67b4205afa5c48e0966bf40c316796a7/users/3189c2fd80734a8d925a3de2d93eab32/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:23:06.161091 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a4c4a-0ec9-46b6-bf6f-b542244fe267 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:06.161609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a4c4a-0ec9-46b6-bf6f-b542244fe267 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:06.161609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a4c4a-0ec9-46b6-bf6f-b542244fe267 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:06.162956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 452/898] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:23:06.168206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93693d-18e2-4edc-b995-b1222026ce76 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:06.168630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93693d-18e2-4edc-b995-b1222026ce76 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:06.168793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93693d-18e2-4edc-b995-b1222026ce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:06.187067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-be93693d-18e2-4edc-b995-b1222026ce76 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:23:06.188228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-be93693d-18e2-4edc-b995-b1222026ce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:23:06.252281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 447/899] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:23:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:23:06.518469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a4c4a-0ec9-46b6-bf6f-b542244fe267 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:06.579341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:06.618794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a4c4a-0ec9-46b6-bf6f-b542244fe267 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:06.650505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e9adf-0c4c-4f7e-a67a-8cfada00f66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:06.651109 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e9adf-0c4c-4f7e-a67a-8cfada00f66a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:06.651387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e9adf-0c4c-4f7e-a67a-8cfada00f66a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:06.651656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e9adf-0c4c-4f7e-a67a-8cfada00f66a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:06.661862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e9adf-0c4c-4f7e-a67a-8cfada00f66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-426e9adf-0c4c-4f7e-a67a-8cfada00f66a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:23:06.666600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:23:06.667686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:23:06.668921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 453/900] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:23:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:23:06.673673 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93693d-18e2-4edc-b995-b1222026ce76 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:06.700831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:06.771271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93693d-18e2-4edc-b995-b1222026ce76 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:06.804410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dfa40-b599-446d-b3f4-5533100d3cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:06.805018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dfa40-b599-446d-b3f4-5533100d3cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:06.805296 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dfa40-b599-446d-b3f4-5533100d3cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:06.805565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dfa40-b599-446d-b3f4-5533100d3cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:06.806213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dfa40-b599-446d-b3f4-5533100d3cd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:23:06.806513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dfa40-b599-446d-b3f4-5533100d3cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:06.807953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dfa40-b599-446d-b3f4-5533100d3cd6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:06.815605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 448/901] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:23:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:23:06.821518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e9adf-0c4c-4f7e-a67a-8cfada00f66a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:06.917929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e9adf-0c4c-4f7e-a67a-8cfada00f66a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:06.939251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:06.950669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b242753-95a7-4abb-aead-05eccc0a6cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:06.951274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b242753-95a7-4abb-aead-05eccc0a6cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:06.951551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b242753-95a7-4abb-aead-05eccc0a6cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:06.951820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b242753-95a7-4abb-aead-05eccc0a6cf7 None admin] PATH_INFO: `/v3/users/3189c2fd80734a8d925a3de2d93eab32` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:06.952947 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b242753-95a7-4abb-aead-05eccc0a6cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=3189c2fd80734a8d925a3de2d93eab32)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:06.954371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b242753-95a7-4abb-aead-05eccc0a6cf7 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:06.955906 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 454/902] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Nov 2 03:23:06 2022] GET /identity/v3/users/3189c2fd80734a8d925a3de2d93eab32 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:23:06.962301 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dfa40-b599-446d-b3f4-5533100d3cd6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:07.050633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:07.060397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dfa40-b599-446d-b3f4-5533100d3cd6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:07.093004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd726e-ddab-4b47-96c6-4d33f1a37ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:07.093600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd726e-ddab-4b47-96c6-4d33f1a37ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:07.093877 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd726e-ddab-4b47-96c6-4d33f1a37ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:07.094172 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd726e-ddab-4b47-96c6-4d33f1a37ca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:07.158925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd726e-ddab-4b47-96c6-4d33f1a37ca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:07.160978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd726e-ddab-4b47-96c6-4d33f1a37ca2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:07.244549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:07.254893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 449/903] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:23:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 03:23:07.260888 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b242753-95a7-4abb-aead-05eccc0a6cf7 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:07.356307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b242753-95a7-4abb-aead-05eccc0a6cf7 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:07.388517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a40e3-254e-4b0e-88cd-da28d7172c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:07.389120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a40e3-254e-4b0e-88cd-da28d7172c4f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:07.389397 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a40e3-254e-4b0e-88cd-da28d7172c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:07.389668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a40e3-254e-4b0e-88cd-da28d7172c4f None admin] PATH_INFO: `/v3/projects/67b4205afa5c48e0966bf40c316796a7` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:07.390753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a40e3-254e-4b0e-88cd-da28d7172c4f None admin] RBAC: Authorizing `identity:get_project(project_id=67b4205afa5c48e0966bf40c316796a7)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:07.392169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a40e3-254e-4b0e-88cd-da28d7172c4f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:07.393774 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 455/904] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Nov 2 03:23:07 2022] GET /identity/v3/projects/67b4205afa5c48e0966bf40c316796a7 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:23:07.400384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd726e-ddab-4b47-96c6-4d33f1a37ca2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:23:07.496057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd726e-ddab-4b47-96c6-4d33f1a37ca2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:23:07.529295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700524ac-c622-413d-a23d-879e09a38fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:23:07.529878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700524ac-c622-413d-a23d-879e09a38fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:23:07.530157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700524ac-c622-413d-a23d-879e09a38fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:23:07.530427 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700524ac-c622-413d-a23d-879e09a38fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:23:07.531138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700524ac-c622-413d-a23d-879e09a38fd3 None admin] RBAC: Adding query filter params (role.id=9a4fa7f48c24440cae54bb4ec26b5b49, scope.project.id=67b4205afa5c48e0966bf40c316796a7, user.id=3189c2fd80734a8d925a3de2d93eab32) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:23:07.531443 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700524ac-c622-413d-a23d-879e09a38fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:23:07.532868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700524ac-c622-413d-a23d-879e09a38fd3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:23:07.538495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 450/905] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:23:07 2022] GET /identity/v3/role_assignments?user.id=3189c2fd80734a8d925a3de2d93eab32&scope.project.id=67b4205afa5c48e0966bf40c316796a7&role.id=9a4fa7f48c24440cae54bb4ec26b5b49 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:23:17.384703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=71 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:23:17.536031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=73 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:03.273238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec956d88-87fd-49b4-a2b0-488fbd1cbb4d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:03.273238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec956d88-87fd-49b4-a2b0-488fbd1cbb4d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:03.273238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec956d88-87fd-49b4-a2b0-488fbd1cbb4d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:03.273238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 456/906] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:24:03.280103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1cd70-c09c-438d-b397-f4ab83c561b1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:03.280620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1cd70-c09c-438d-b397-f4ab83c561b1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:03.280832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1cd70-c09c-438d-b397-f4ab83c561b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:03.308200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-04b1cd70-c09c-438d-b397-f4ab83c561b1 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:24:03.310040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-04b1cd70-c09c-438d-b397-f4ab83c561b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:24:03.420132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 451/907] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:24:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:24:03.697278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec956d88-87fd-49b4-a2b0-488fbd1cbb4d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:03.863610 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec956d88-87fd-49b4-a2b0-488fbd1cbb4d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:03.922486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0500cb-06d0-4edd-a6b4-7871f4805181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:03.924218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0500cb-06d0-4edd-a6b4-7871f4805181 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:03.924971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0500cb-06d0-4edd-a6b4-7871f4805181 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:03.925288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0500cb-06d0-4edd-a6b4-7871f4805181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:03.938488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0500cb-06d0-4edd-a6b4-7871f4805181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:03.941951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0500cb-06d0-4edd-a6b4-7871f4805181 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-8d0500cb-06d0-4edd-a6b4-7871f4805181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:24:03.966226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:03.975336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:24:03.976321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:24:03.976321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:03.976321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:03.976321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 457/908] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:03.976606 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1cd70-c09c-438d-b397-f4ab83c561b1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:04.109077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1cd70-c09c-438d-b397-f4ab83c561b1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:04.144006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:04.155964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1e2f6-7cb1-4b1a-907c-2eb018f1d043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:04.157050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1e2f6-7cb1-4b1a-907c-2eb018f1d043 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:04.157432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1e2f6-7cb1-4b1a-907c-2eb018f1d043 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:04.157699 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1e2f6-7cb1-4b1a-907c-2eb018f1d043 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:04.158410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1e2f6-7cb1-4b1a-907c-2eb018f1d043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:04.158717 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1e2f6-7cb1-4b1a-907c-2eb018f1d043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:04.160305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1e2f6-7cb1-4b1a-907c-2eb018f1d043 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:04.176515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 452/909] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:04.182778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0500cb-06d0-4edd-a6b4-7871f4805181 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:04.244202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:04.310766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0500cb-06d0-4edd-a6b4-7871f4805181 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:04.356492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeb060-c273-4a46-8d1b-da9fc2e9abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:04.359842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeb060-c273-4a46-8d1b-da9fc2e9abf3 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:04.359842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeb060-c273-4a46-8d1b-da9fc2e9abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:04.359842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeb060-c273-4a46-8d1b-da9fc2e9abf3 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:04.359842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbeb060-c273-4a46-8d1b-da9fc2e9abf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:04.359842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbeb060-c273-4a46-8d1b-da9fc2e9abf3 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:04.382704 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 458/910] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Nov 2 03:24:04 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:24:06.942640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607092e2-a76f-416f-992d-6b9bdb0b22d5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:06.943191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607092e2-a76f-416f-992d-6b9bdb0b22d5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:06.943383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607092e2-a76f-416f-992d-6b9bdb0b22d5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:06.944791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 453/911] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:24:06.951189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306577de-6713-4a94-a7bf-3c7972674fdd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:06.951650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306577de-6713-4a94-a7bf-3c7972674fdd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:06.951743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306577de-6713-4a94-a7bf-3c7972674fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:06.971896 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-306577de-6713-4a94-a7bf-3c7972674fdd None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:24:06.973120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-306577de-6713-4a94-a7bf-3c7972674fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:24:07.062687 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 459/912] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:24:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:24:07.383568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607092e2-a76f-416f-992d-6b9bdb0b22d5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:07.505546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607092e2-a76f-416f-992d-6b9bdb0b22d5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:07.545039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c498397-4b99-4c92-8545-063749552495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:07.545672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498397-4b99-4c92-8545-063749552495 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:07.545948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498397-4b99-4c92-8545-063749552495 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:07.546215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498397-4b99-4c92-8545-063749552495 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:07.558523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c498397-4b99-4c92-8545-063749552495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5c498397-4b99-4c92-8545-063749552495 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:24:07.563453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:07.564869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:24:07.565997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:07.569899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 454/913] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:24:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:07.571367 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306577de-6713-4a94-a7bf-3c7972674fdd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:07.615630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:07.689952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306577de-6713-4a94-a7bf-3c7972674fdd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:07.726532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffcd67-f83f-4716-9146-c242a47096cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:07.727191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffcd67-f83f-4716-9146-c242a47096cb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:07.727485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffcd67-f83f-4716-9146-c242a47096cb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:07.727740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffcd67-f83f-4716-9146-c242a47096cb None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:07.728564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffcd67-f83f-4716-9146-c242a47096cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:07.728855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffcd67-f83f-4716-9146-c242a47096cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:07.730316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffcd67-f83f-4716-9146-c242a47096cb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:07.747683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 460/914] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:24:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:07.749431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c498397-4b99-4c92-8545-063749552495 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:07.811972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:07.865524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c498397-4b99-4c92-8545-063749552495 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:07.902621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a33be-bb74-4999-954e-4c8c8376a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:07.903374 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a33be-bb74-4999-954e-4c8c8376a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:07.903677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a33be-bb74-4999-954e-4c8c8376a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:07.903947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a33be-bb74-4999-954e-4c8c8376a7a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:07.916889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a33be-bb74-4999-954e-4c8c8376a7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:07.918644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a33be-bb74-4999-954e-4c8c8376a7a7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-374a33be-bb74-4999-954e-4c8c8376a7a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:24:07.937316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:07.938447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:24:07.939316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:24:07.939316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:07.939316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:07.939316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 455/915] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:07.944823 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffcd67-f83f-4716-9146-c242a47096cb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:08.060454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:08.064214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffcd67-f83f-4716-9146-c242a47096cb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:08.105507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b116ad-1f22-4d0c-ba6f-d70aed24f306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:08.106119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b116ad-1f22-4d0c-ba6f-d70aed24f306 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:08.106595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b116ad-1f22-4d0c-ba6f-d70aed24f306 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:08.107068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b116ad-1f22-4d0c-ba6f-d70aed24f306 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:08.107974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b116ad-1f22-4d0c-ba6f-d70aed24f306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:08.108321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b116ad-1f22-4d0c-ba6f-d70aed24f306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:08.109885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b116ad-1f22-4d0c-ba6f-d70aed24f306 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:08.127854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 461/916] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:08.129021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a33be-bb74-4999-954e-4c8c8376a7a7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:08.256358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a33be-bb74-4999-954e-4c8c8376a7a7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:08.258130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:08.296741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17684c27-e056-4098-baf8-ba70f2ced583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:08.297382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684c27-e056-4098-baf8-ba70f2ced583 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:08.298521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684c27-e056-4098-baf8-ba70f2ced583 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:08.298801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17684c27-e056-4098-baf8-ba70f2ced583 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:08.306488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17684c27-e056-4098-baf8-ba70f2ced583 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:08.308031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17684c27-e056-4098-baf8-ba70f2ced583 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-17684c27-e056-4098-baf8-ba70f2ced583 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:24:08.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:08.321725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:08.327883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 456/917] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:08.328495 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b116ad-1f22-4d0c-ba6f-d70aed24f306 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:08.451360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b116ad-1f22-4d0c-ba6f-d70aed24f306 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:08.493628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf50e-60fe-4431-bad1-3ecf81604cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:08.494242 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf50e-60fe-4431-bad1-3ecf81604cce None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:08.494518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf50e-60fe-4431-bad1-3ecf81604cce None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:08.494787 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf50e-60fe-4431-bad1-3ecf81604cce None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:08.495515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebf50e-60fe-4431-bad1-3ecf81604cce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:08.495817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebf50e-60fe-4431-bad1-3ecf81604cce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:08.497337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebf50e-60fe-4431-bad1-3ecf81604cce None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:08.524103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 462/918] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Nov 2 03:24:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:08.525615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17684c27-e056-4098-baf8-ba70f2ced583 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:08.639669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17684c27-e056-4098-baf8-ba70f2ced583 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:08.687501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd7ee1-394a-4d0b-bd6d-78f06fa44d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:08.688229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd7ee1-394a-4d0b-bd6d-78f06fa44d3d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:08.688556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd7ee1-394a-4d0b-bd6d-78f06fa44d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:08.688881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd7ee1-394a-4d0b-bd6d-78f06fa44d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:08.700232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd7ee1-394a-4d0b-bd6d-78f06fa44d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:08.701797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd7ee1-394a-4d0b-bd6d-78f06fa44d3d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4acd7ee1-394a-4d0b-bd6d-78f06fa44d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:24:08.716633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:08.722671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:24:08.723750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:24:08.723750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:08.723750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:08.723750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 457/919] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:08.725140 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf50e-60fe-4431-bad1-3ecf81604cce None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:08.754239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:08.859171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf50e-60fe-4431-bad1-3ecf81604cce None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:08.898308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9fc9e-66ee-407a-a2d7-427da028b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:08.898930 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9fc9e-66ee-407a-a2d7-427da028b85b None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:08.899201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9fc9e-66ee-407a-a2d7-427da028b85b None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:08.899471 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9fc9e-66ee-407a-a2d7-427da028b85b None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:08.900122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9fc9e-66ee-407a-a2d7-427da028b85b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:08.900535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9fc9e-66ee-407a-a2d7-427da028b85b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:08.901827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9fc9e-66ee-407a-a2d7-427da028b85b None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:08.914984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 463/920] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:08.920870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd7ee1-394a-4d0b-bd6d-78f06fa44d3d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:08.938617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:09.054432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd7ee1-394a-4d0b-bd6d-78f06fa44d3d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:09.095233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97a94b-df22-464c-885b-1e7e1dfe6b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:09.095868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97a94b-df22-464c-885b-1e7e1dfe6b10 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:09.096151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97a94b-df22-464c-885b-1e7e1dfe6b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:09.096428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97a94b-df22-464c-885b-1e7e1dfe6b10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:09.104258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97a94b-df22-464c-885b-1e7e1dfe6b10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:09.105756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97a94b-df22-464c-885b-1e7e1dfe6b10 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0a97a94b-df22-464c-885b-1e7e1dfe6b10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:24:09.120433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:09.121410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:09.127344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:24:09.127344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:24:09.127344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:24:09.127344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:24:09.127344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:24:09.127344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:24:09.127344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:24:09.127344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:09.127344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 458/921] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:24:09.128389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9fc9e-66ee-407a-a2d7-427da028b85b None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:09.216357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:09.243878 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9fc9e-66ee-407a-a2d7-427da028b85b None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:09.283346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3e3f0-20ce-4530-8dd8-15bf7c7be23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:09.284329 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e3f0-20ce-4530-8dd8-15bf7c7be23c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:09.284797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e3f0-20ce-4530-8dd8-15bf7c7be23c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:09.285268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e3f0-20ce-4530-8dd8-15bf7c7be23c None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:09.286488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3e3f0-20ce-4530-8dd8-15bf7c7be23c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:09.287017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3e3f0-20ce-4530-8dd8-15bf7c7be23c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:09.288920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3e3f0-20ce-4530-8dd8-15bf7c7be23c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:09.302593 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 464/922] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:09.308687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97a94b-df22-464c-885b-1e7e1dfe6b10 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:09.394598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:09.419860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97a94b-df22-464c-885b-1e7e1dfe6b10 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:09.454349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dead3-d8f2-4356-b6b7-420b53233566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:09.454996 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dead3-d8f2-4356-b6b7-420b53233566 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:09.455274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dead3-d8f2-4356-b6b7-420b53233566 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:09.455546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dead3-d8f2-4356-b6b7-420b53233566 None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/91b2777a51af45f5a86627d840f5b814/roles/2840a8ea5485428fad61d84f364bcecb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:09.470102 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dead3-d8f2-4356-b6b7-420b53233566 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=91b2777a51af45f5a86627d840f5b814, role_id=2840a8ea5485428fad61d84f364bcecb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:09.471524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dead3-d8f2-4356-b6b7-420b53233566 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:09.487527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 459/923] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:24:09 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/91b2777a51af45f5a86627d840f5b814/roles/2840a8ea5485428fad61d84f364bcecb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:24:11.852361 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4b6ae-619f-42f5-9049-53853781ac57 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:11.852942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4b6ae-619f-42f5-9049-53853781ac57 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:11.852942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4b6ae-619f-42f5-9049-53853781ac57 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:11.854414 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 465/924] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:24:11.860743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5b95-faa2-4790-9ba9-a0c88d3a3d65 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:11.860743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5b95-faa2-4790-9ba9-a0c88d3a3d65 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:11.861564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5b95-faa2-4790-9ba9-a0c88d3a3d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:11.881194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-27bc5b95-faa2-4790-9ba9-a0c88d3a3d65 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:24:11.882426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-27bc5b95-faa2-4790-9ba9-a0c88d3a3d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:24:11.953578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 460/925] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:24:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:24:12.226880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4b6ae-619f-42f5-9049-53853781ac57 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:12.334738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4b6ae-619f-42f5-9049-53853781ac57 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:12.380566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906bdf7-3d22-4637-b837-586461722919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:12.381198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906bdf7-3d22-4637-b837-586461722919 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:12.381475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906bdf7-3d22-4637-b837-586461722919 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:12.381745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906bdf7-3d22-4637-b837-586461722919 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:12.389192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:12.394671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906bdf7-3d22-4637-b837-586461722919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7906bdf7-3d22-4637-b837-586461722919 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:24:12.400067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:12.401100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:12.401951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 466/926] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Nov 2 03:24:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:12.409657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5b95-faa2-4790-9ba9-a0c88d3a3d65 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:12.465631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:12.513957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5b95-faa2-4790-9ba9-a0c88d3a3d65 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:12.554320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc8ba9-e12b-4eed-aee6-da04a33f8475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:12.555197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc8ba9-e12b-4eed-aee6-da04a33f8475 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:12.555528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc8ba9-e12b-4eed-aee6-da04a33f8475 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:12.555904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc8ba9-e12b-4eed-aee6-da04a33f8475 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:12.556842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc8ba9-e12b-4eed-aee6-da04a33f8475 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:12.557314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc8ba9-e12b-4eed-aee6-da04a33f8475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:12.559086 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc8ba9-e12b-4eed-aee6-da04a33f8475 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:12.572200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 461/927] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Nov 2 03:24:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:24:12.579454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906bdf7-3d22-4637-b837-586461722919 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:12.696078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906bdf7-3d22-4637-b837-586461722919 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:12.739772 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92c6de-f380-4942-8637-9171f2116687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:12.740794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92c6de-f380-4942-8637-9171f2116687 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:12.741197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92c6de-f380-4942-8637-9171f2116687 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:12.741508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92c6de-f380-4942-8637-9171f2116687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:12.755296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92c6de-f380-4942-8637-9171f2116687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:12.757991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92c6de-f380-4942-8637-9171f2116687 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-7a92c6de-f380-4942-8637-9171f2116687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:24:12.779971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:12.781015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:24:12.782556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:24:12.782556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:12.782556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:12.782556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 467/928] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 03:24:12.787925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc8ba9-e12b-4eed-aee6-da04a33f8475 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:12.918422 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc8ba9-e12b-4eed-aee6-da04a33f8475 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:12.935977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:12.955336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350e3f-54a2-429a-9f21-eaa6f352664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:12.955944 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350e3f-54a2-429a-9f21-eaa6f352664c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:12.956228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350e3f-54a2-429a-9f21-eaa6f352664c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:12.956550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350e3f-54a2-429a-9f21-eaa6f352664c None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:12.957229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f350e3f-54a2-429a-9f21-eaa6f352664c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:12.957533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f350e3f-54a2-429a-9f21-eaa6f352664c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:12.958875 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f350e3f-54a2-429a-9f21-eaa6f352664c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:12.971882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 462/929] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:12.977938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92c6de-f380-4942-8637-9171f2116687 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:13.032516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:13.083832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92c6de-f380-4942-8637-9171f2116687 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:13.126805 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7e5f-941a-44c5-91ec-eb1412cb69be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:13.127434 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7e5f-941a-44c5-91ec-eb1412cb69be None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:13.127710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7e5f-941a-44c5-91ec-eb1412cb69be None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:13.127983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7e5f-941a-44c5-91ec-eb1412cb69be None admin] PATH_INFO: `/v3/users/placement` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:13.135563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc7e5f-941a-44c5-91ec-eb1412cb69be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:13.137305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc7e5f-941a-44c5-91ec-eb1412cb69be None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-3bdc7e5f-941a-44c5-91ec-eb1412cb69be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:24:13.150159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:13.151278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:13.152383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 468/930] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:13.157659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350e3f-54a2-429a-9f21-eaa6f352664c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:13.298342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350e3f-54a2-429a-9f21-eaa6f352664c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:13.339007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2520df-9636-45a1-a879-c8bc7a5ba280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:13.339741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2520df-9636-45a1-a879-c8bc7a5ba280 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:13.340021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2520df-9636-45a1-a879-c8bc7a5ba280 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:13.340297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2520df-9636-45a1-a879-c8bc7a5ba280 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:13.341048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2520df-9636-45a1-a879-c8bc7a5ba280 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:13.341351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2520df-9636-45a1-a879-c8bc7a5ba280 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:13.342752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2520df-9636-45a1-a879-c8bc7a5ba280 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:13.371246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 463/931] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Nov 2 03:24:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:13.372299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7e5f-941a-44c5-91ec-eb1412cb69be None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:13.486464 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7e5f-941a-44c5-91ec-eb1412cb69be None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:13.497268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:13.523569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a973d-30fa-47d1-b3cf-a694a6954f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:13.524190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a973d-30fa-47d1-b3cf-a694a6954f20 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:13.524540 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a973d-30fa-47d1-b3cf-a694a6954f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:13.524803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a973d-30fa-47d1-b3cf-a694a6954f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:13.599571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a973d-30fa-47d1-b3cf-a694a6954f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:13.599571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a973d-30fa-47d1-b3cf-a694a6954f20 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:13.710269 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 469/932] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:24:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 03:24:13.716159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2520df-9636-45a1-a879-c8bc7a5ba280 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:13.755718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:13.833746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2520df-9636-45a1-a879-c8bc7a5ba280 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:13.876824 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c5b99-0339-4893-955b-3c8ec986fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:13.877601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5b99-0339-4893-955b-3c8ec986fadc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:13.878002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5b99-0339-4893-955b-3c8ec986fadc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:13.878400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5b99-0339-4893-955b-3c8ec986fadc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:13.892042 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c5b99-0339-4893-955b-3c8ec986fadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:13.893912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c5b99-0339-4893-955b-3c8ec986fadc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-841c5b99-0339-4893-955b-3c8ec986fadc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:24:13.910414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:13.917004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:24:13.918091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:24:13.918091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:13.918091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:13.918091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 464/933] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:13.920191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a973d-30fa-47d1-b3cf-a694a6954f20 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:13.931887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:14.031345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a973d-30fa-47d1-b3cf-a694a6954f20 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:14.071180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579f2e8-7d9f-4b9a-b2ac-095ca486daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:14.071793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579f2e8-7d9f-4b9a-b2ac-095ca486daf6 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:14.072078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579f2e8-7d9f-4b9a-b2ac-095ca486daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:14.072355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579f2e8-7d9f-4b9a-b2ac-095ca486daf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:14.073026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579f2e8-7d9f-4b9a-b2ac-095ca486daf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:14.073332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579f2e8-7d9f-4b9a-b2ac-095ca486daf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:14.074700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579f2e8-7d9f-4b9a-b2ac-095ca486daf6 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:14.087384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 470/934] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:14.092752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c5b99-0339-4893-955b-3c8ec986fadc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:14.184854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:14.204800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c5b99-0339-4893-955b-3c8ec986fadc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:14.246780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c0c2e-8e3f-4f3f-baef-905084d5c9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:14.247405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c0c2e-8e3f-4f3f-baef-905084d5c9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:14.247768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c0c2e-8e3f-4f3f-baef-905084d5c9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:14.248064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c0c2e-8e3f-4f3f-baef-905084d5c9e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:14.256132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c0c2e-8e3f-4f3f-baef-905084d5c9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:14.257667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c0c2e-8e3f-4f3f-baef-905084d5c9e3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-df2c0c2e-8e3f-4f3f-baef-905084d5c9e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:24:14.271842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:14.273066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:14.274129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:24:14.274129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:24:14.274129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:24:14.274129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:24:14.274129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:24:14.274129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:24:14.274129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:24:14.274129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:14.274129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 465/935] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:14.279014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579f2e8-7d9f-4b9a-b2ac-095ca486daf6 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:14.363211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:14.397733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579f2e8-7d9f-4b9a-b2ac-095ca486daf6 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:14.433669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a078a88-a677-4e8e-a2e6-838870388b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:14.434267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078a88-a677-4e8e-a2e6-838870388b4c None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:14.434545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078a88-a677-4e8e-a2e6-838870388b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:14.434815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078a88-a677-4e8e-a2e6-838870388b4c None admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:14.435541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a078a88-a677-4e8e-a2e6-838870388b4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:14.435796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a078a88-a677-4e8e-a2e6-838870388b4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:14.437246 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a078a88-a677-4e8e-a2e6-838870388b4c None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:14.455933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 471/936] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:24:14.457213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c0c2e-8e3f-4f3f-baef-905084d5c9e3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:14.559206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c0c2e-8e3f-4f3f-baef-905084d5c9e3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:14.596295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fbb8a-24ee-4a7a-98d0-ee47fb9d4ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:14.596997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fbb8a-24ee-4a7a-98d0-ee47fb9d4ced None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:14.597344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fbb8a-24ee-4a7a-98d0-ee47fb9d4ced None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:14.597659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fbb8a-24ee-4a7a-98d0-ee47fb9d4ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:14.598454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fbb8a-24ee-4a7a-98d0-ee47fb9d4ced None admin] RBAC: Adding query filter params (role.id=2840a8ea5485428fad61d84f364bcecb, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=91b2777a51af45f5a86627d840f5b814) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:14.598846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fbb8a-24ee-4a7a-98d0-ee47fb9d4ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:14.600527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fbb8a-24ee-4a7a-98d0-ee47fb9d4ced None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:14.606733 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 466/937] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:24:14 2022] GET /identity/v3/role_assignments?user.id=91b2777a51af45f5a86627d840f5b814&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=2840a8ea5485428fad61d84f364bcecb => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:16.902461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01c7a-1475-4597-b42b-c77f020eda96 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:16.903033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01c7a-1475-4597-b42b-c77f020eda96 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:16.903033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf01c7a-1475-4597-b42b-c77f020eda96 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:16.904603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 472/938] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:24:16.910561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbe96a-5eed-4130-a3bc-b03fe20512ca None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:16.911006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbe96a-5eed-4130-a3bc-b03fe20512ca None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:16.911177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbe96a-5eed-4130-a3bc-b03fe20512ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:16.929703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-28dbe96a-5eed-4130-a3bc-b03fe20512ca None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:24:16.930927 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-28dbe96a-5eed-4130-a3bc-b03fe20512ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:24:16.933817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:17.004126 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 467/939] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:24:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 03:24:17.275526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf01c7a-1475-4597-b42b-c77f020eda96 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:17.402552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf01c7a-1475-4597-b42b-c77f020eda96 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:17.434097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:17.441542 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7413-a90c-4cc1-9376-58c6bd124e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:17.442289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7413-a90c-4cc1-9376-58c6bd124e67 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:17.442596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7413-a90c-4cc1-9376-58c6bd124e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:17.442896 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7413-a90c-4cc1-9376-58c6bd124e67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:17.454286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d7413-a90c-4cc1-9376-58c6bd124e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a70d7413-a90c-4cc1-9376-58c6bd124e67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:24:17.459569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:17.460550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:17.461411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 473/940] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:17.466619 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbe96a-5eed-4130-a3bc-b03fe20512ca None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:17.578234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbe96a-5eed-4130-a3bc-b03fe20512ca None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:17.617414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecf7ba-1201-4a9c-9bec-0590fb1060b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:17.618025 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecf7ba-1201-4a9c-9bec-0590fb1060b7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:17.618303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecf7ba-1201-4a9c-9bec-0590fb1060b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:17.618574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecf7ba-1201-4a9c-9bec-0590fb1060b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:17.619237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecf7ba-1201-4a9c-9bec-0590fb1060b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:17.619540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecf7ba-1201-4a9c-9bec-0590fb1060b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:17.621118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecf7ba-1201-4a9c-9bec-0590fb1060b7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:17.630842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 468/941] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:17.637287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7413-a90c-4cc1-9376-58c6bd124e67 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:17.751405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7413-a90c-4cc1-9376-58c6bd124e67 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:17.796437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f3a28-1752-4dca-91d7-444b0bac733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:17.797754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f3a28-1752-4dca-91d7-444b0bac733f None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:17.798546 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f3a28-1752-4dca-91d7-444b0bac733f None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:17.798835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f3a28-1752-4dca-91d7-444b0bac733f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:17.811305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f3a28-1752-4dca-91d7-444b0bac733f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:17.813493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f3a28-1752-4dca-91d7-444b0bac733f None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-267f3a28-1752-4dca-91d7-444b0bac733f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:24:17.831171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:17.832323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:24:17.833380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:24:17.833380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:17.833380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:17.833380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 474/942] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:17.839288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecf7ba-1201-4a9c-9bec-0590fb1060b7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:17.842295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:17.962024 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecf7ba-1201-4a9c-9bec-0590fb1060b7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:18.000078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab82023-e38c-458f-abd9-ccf1f369a191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:18.000723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab82023-e38c-458f-abd9-ccf1f369a191 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:18.001003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab82023-e38c-458f-abd9-ccf1f369a191 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:18.001271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab82023-e38c-458f-abd9-ccf1f369a191 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:18.001910 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab82023-e38c-458f-abd9-ccf1f369a191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:18.002211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab82023-e38c-458f-abd9-ccf1f369a191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:18.003562 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab82023-e38c-458f-abd9-ccf1f369a191 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:18.018662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 469/943] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:18.024830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f3a28-1752-4dca-91d7-444b0bac733f None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:18.083161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:18.148163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f3a28-1752-4dca-91d7-444b0bac733f None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:18.185065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f6904-5774-47c6-9dfc-d33a28af097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:18.185675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6904-5774-47c6-9dfc-d33a28af097a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:18.185974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6904-5774-47c6-9dfc-d33a28af097a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:18.186280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6904-5774-47c6-9dfc-d33a28af097a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:18.195054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f6904-5774-47c6-9dfc-d33a28af097a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:18.196854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f6904-5774-47c6-9dfc-d33a28af097a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-ca0f6904-5774-47c6-9dfc-d33a28af097a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:24:18.210665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:18.211975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:18.213007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 475/944] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:18.217735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab82023-e38c-458f-abd9-ccf1f369a191 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:18.294122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:18.346568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab82023-e38c-458f-abd9-ccf1f369a191 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:18.392121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a74c43-4091-4484-809d-42aa1bbe327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:18.392391 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a74c43-4091-4484-809d-42aa1bbe327d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:18.392510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a74c43-4091-4484-809d-42aa1bbe327d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:18.392744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a74c43-4091-4484-809d-42aa1bbe327d None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:18.393469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a74c43-4091-4484-809d-42aa1bbe327d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:18.393805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a74c43-4091-4484-809d-42aa1bbe327d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:18.395355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a74c43-4091-4484-809d-42aa1bbe327d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:18.413930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 470/945] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Nov 2 03:24:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:18.420725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f6904-5774-47c6-9dfc-d33a28af097a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:18.548825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f6904-5774-47c6-9dfc-d33a28af097a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:18.550734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:18.600735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9764d7e-185d-44e8-b6ce-41b5cf523f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:18.601339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9764d7e-185d-44e8-b6ce-41b5cf523f20 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:18.601618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9764d7e-185d-44e8-b6ce-41b5cf523f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:18.601888 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9764d7e-185d-44e8-b6ce-41b5cf523f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:18.616481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9764d7e-185d-44e8-b6ce-41b5cf523f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:18.618470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9764d7e-185d-44e8-b6ce-41b5cf523f20 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-a9764d7e-185d-44e8-b6ce-41b5cf523f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:24:18.638705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:18.639989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:24:18.641644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:24:18.641644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:18.641644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:18.641644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 476/946] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:18.651701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a74c43-4091-4484-809d-42aa1bbe327d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:18.780034 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a74c43-4091-4484-809d-42aa1bbe327d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:18.806162 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:18.826250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeb491-57ef-4caf-a299-221c9dad366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:18.827608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeb491-57ef-4caf-a299-221c9dad366c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:18.828019 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeb491-57ef-4caf-a299-221c9dad366c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:18.829092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeb491-57ef-4caf-a299-221c9dad366c None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:18.830104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeb491-57ef-4caf-a299-221c9dad366c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:18.830598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeb491-57ef-4caf-a299-221c9dad366c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:18.832479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeb491-57ef-4caf-a299-221c9dad366c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:18.848551 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 471/947] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:18.858521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9764d7e-185d-44e8-b6ce-41b5cf523f20 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:18.991021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9764d7e-185d-44e8-b6ce-41b5cf523f20 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:19.033601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d7e3-f24f-4322-bb6a-a18f8e78ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:19.034304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d7e3-f24f-4322-bb6a-a18f8e78ae3a None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:19.034581 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d7e3-f24f-4322-bb6a-a18f8e78ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:19.034776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d7e3-f24f-4322-bb6a-a18f8e78ae3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:19.043041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3d7e3-f24f-4322-bb6a-a18f8e78ae3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:19.044597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3d7e3-f24f-4322-bb6a-a18f8e78ae3a None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-76b3d7e3-f24f-4322-bb6a-a18f8e78ae3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:24:19.058864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:19.060013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:19.061202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:24:19.061202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:24:19.061202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:24:19.061202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:24:19.061202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:24:19.061202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:24:19.061202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:24:19.061202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:19.061202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 477/948] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:19.067486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeb491-57ef-4caf-a299-221c9dad366c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:19.188918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeb491-57ef-4caf-a299-221c9dad366c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:19.232303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de73f76-c280-4dbe-b8dd-2fcc088c987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:19.232961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de73f76-c280-4dbe-b8dd-2fcc088c987a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:19.233242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de73f76-c280-4dbe-b8dd-2fcc088c987a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:19.233513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de73f76-c280-4dbe-b8dd-2fcc088c987a None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:19.234208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de73f76-c280-4dbe-b8dd-2fcc088c987a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:19.235125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de73f76-c280-4dbe-b8dd-2fcc088c987a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:19.237592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de73f76-c280-4dbe-b8dd-2fcc088c987a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:19.251941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 472/949] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:19.258644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d7e3-f24f-4322-bb6a-a18f8e78ae3a None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:19.276350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:19.381843 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d7e3-f24f-4322-bb6a-a18f8e78ae3a None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:19.426709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54809f5a-1729-4dc1-bd79-2f8561cf7a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:19.427396 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809f5a-1729-4dc1-bd79-2f8561cf7a95 None admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:19.427672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809f5a-1729-4dc1-bd79-2f8561cf7a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:19.428012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809f5a-1729-4dc1-bd79-2f8561cf7a95 None admin] PATH_INFO: `/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/91b2777a51af45f5a86627d840f5b814/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:19.429958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54809f5a-1729-4dc1-bd79-2f8561cf7a95 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58acd3f17934bdfb90e72c13bc0ef9d, user_id=91b2777a51af45f5a86627d840f5b814, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:19.431377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54809f5a-1729-4dc1-bd79-2f8561cf7a95 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:19.447535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 478/950] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Nov 2 03:24:19 2022] PUT /identity/v3/projects/d58acd3f17934bdfb90e72c13bc0ef9d/users/91b2777a51af45f5a86627d840f5b814/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:24:21.928714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100cb68-b1ee-4595-8350-990b816d737a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:21.929555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100cb68-b1ee-4595-8350-990b816d737a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:21.929721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100cb68-b1ee-4595-8350-990b816d737a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:21.931161 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 473/951] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:24:21.936822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8024-78e6-423a-85c1-49fe793fa09f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:21.937225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8024-78e6-423a-85c1-49fe793fa09f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:21.937380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8024-78e6-423a-85c1-49fe793fa09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:21.955651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cd0c8024-78e6-423a-85c1-49fe793fa09f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:24:21.956897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cd0c8024-78e6-423a-85c1-49fe793fa09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:24:22.035916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 479/952] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:24:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:24:22.319617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100cb68-b1ee-4595-8350-990b816d737a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:22.381594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:22.448651 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100cb68-b1ee-4595-8350-990b816d737a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:22.487968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1bf1f-8495-432b-83ac-e13e8d4871b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:22.488662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1bf1f-8495-432b-83ac-e13e8d4871b2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:22.489007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1bf1f-8495-432b-83ac-e13e8d4871b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:22.489290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1bf1f-8495-432b-83ac-e13e8d4871b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:22.501295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1bf1f-8495-432b-83ac-e13e8d4871b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-77a1bf1f-8495-432b-83ac-e13e8d4871b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 03:24:22.506854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:22.507939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:22.508964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 474/953] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Nov 2 03:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:22.514629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c8024-78e6-423a-85c1-49fe793fa09f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:22.517970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:22.629848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c8024-78e6-423a-85c1-49fe793fa09f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:22.673059 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bac97-9d8e-452e-b0fc-977914f46c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:22.673751 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bac97-9d8e-452e-b0fc-977914f46c0d None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:22.674097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bac97-9d8e-452e-b0fc-977914f46c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:22.674449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bac97-9d8e-452e-b0fc-977914f46c0d None admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:22.675478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bac97-9d8e-452e-b0fc-977914f46c0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:22.675586 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bac97-9d8e-452e-b0fc-977914f46c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:22.677631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bac97-9d8e-452e-b0fc-977914f46c0d None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:22.688059 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 480/954] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Nov 2 03:24:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:22.694713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1bf1f-8495-432b-83ac-e13e8d4871b2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:22.823291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:22.827022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1bf1f-8495-432b-83ac-e13e8d4871b2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:22.865419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87069c2-86b7-41a1-8d6c-7359321b68ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:22.866069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87069c2-86b7-41a1-8d6c-7359321b68ee None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:22.866351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87069c2-86b7-41a1-8d6c-7359321b68ee None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:22.866625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87069c2-86b7-41a1-8d6c-7359321b68ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:22.878331 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87069c2-86b7-41a1-8d6c-7359321b68ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:22.879794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87069c2-86b7-41a1-8d6c-7359321b68ee None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a87069c2-86b7-41a1-8d6c-7359321b68ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:24:22.895854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:22.902005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:24:22.903036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:24:22.903036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:22.903036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:22.903036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 475/955] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:22.903269 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bac97-9d8e-452e-b0fc-977914f46c0d None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:22.973584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:23.014682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bac97-9d8e-452e-b0fc-977914f46c0d None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:23.050665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc64149-83ab-461d-a138-d11ace5355bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:23.051238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc64149-83ab-461d-a138-d11ace5355bb None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:23.051515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc64149-83ab-461d-a138-d11ace5355bb None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:23.051785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc64149-83ab-461d-a138-d11ace5355bb None admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:23.052442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc64149-83ab-461d-a138-d11ace5355bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:23.052773 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc64149-83ab-461d-a138-d11ace5355bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:23.054164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc64149-83ab-461d-a138-d11ace5355bb None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:23.072443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 481/956] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:23.073822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87069c2-86b7-41a1-8d6c-7359321b68ee None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:23.176601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87069c2-86b7-41a1-8d6c-7359321b68ee None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:23.211613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12f0b7-6e5c-4b7b-9749-9939584174bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:23.212241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f0b7-6e5c-4b7b-9749-9939584174bb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:23.212551 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f0b7-6e5c-4b7b-9749-9939584174bb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:23.212825 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f0b7-6e5c-4b7b-9749-9939584174bb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:23.220491 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12f0b7-6e5c-4b7b-9749-9939584174bb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:23.221929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12f0b7-6e5c-4b7b-9749-9939584174bb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8c12f0b7-6e5c-4b7b-9749-9939584174bb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 03:24:23.233127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:23.234064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:23.235348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 476/957] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:23.240561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc64149-83ab-461d-a138-d11ace5355bb None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:23.345053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc64149-83ab-461d-a138-d11ace5355bb None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:23.372200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:23.382039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb079d-1a52-4906-8f52-babc102756f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:23.382651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb079d-1a52-4906-8f52-babc102756f1 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:23.382935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb079d-1a52-4906-8f52-babc102756f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:23.383207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb079d-1a52-4906-8f52-babc102756f1 None admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:23.383949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb079d-1a52-4906-8f52-babc102756f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:23.384256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb079d-1a52-4906-8f52-babc102756f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:23.385720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb079d-1a52-4906-8f52-babc102756f1 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:23.403388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 482/958] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Nov 2 03:24:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:23.409291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12f0b7-6e5c-4b7b-9749-9939584174bb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:23.424848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:23.507345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12f0b7-6e5c-4b7b-9749-9939584174bb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:23.539077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2daa5d-7395-4108-80eb-c07bf343a0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:23.539668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2daa5d-7395-4108-80eb-c07bf343a0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:23.539948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2daa5d-7395-4108-80eb-c07bf343a0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:23.540221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2daa5d-7395-4108-80eb-c07bf343a0f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:23.604942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2daa5d-7395-4108-80eb-c07bf343a0f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:23.606364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2daa5d-7395-4108-80eb-c07bf343a0f4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:23.620875 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:23.703521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 477/959] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Nov 2 03:24:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 03:24:23.709301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb079d-1a52-4906-8f52-babc102756f1 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:23.813420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb079d-1a52-4906-8f52-babc102756f1 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:23.845860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383a6ad-5043-468b-9d8b-c67dfbe59b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:23.846471 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383a6ad-5043-468b-9d8b-c67dfbe59b08 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:23.846748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383a6ad-5043-468b-9d8b-c67dfbe59b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:23.847017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383a6ad-5043-468b-9d8b-c67dfbe59b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:23.856508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383a6ad-5043-468b-9d8b-c67dfbe59b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:23.857935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383a6ad-5043-468b-9d8b-c67dfbe59b08 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-f383a6ad-5043-468b-9d8b-c67dfbe59b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 03:24:23.872985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:23.874053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 03:24:23.875116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 03:24:23.875116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 03:24:23.875116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:23.875116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 483/960] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:23.879873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2daa5d-7395-4108-80eb-c07bf343a0f4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:23.981340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2daa5d-7395-4108-80eb-c07bf343a0f4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:23.996023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:24.019080 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c02d6-b4f1-4aa7-82e2-27ff18ac7304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:24.019740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c02d6-b4f1-4aa7-82e2-27ff18ac7304 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:24.020052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c02d6-b4f1-4aa7-82e2-27ff18ac7304 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:24.020364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c02d6-b4f1-4aa7-82e2-27ff18ac7304 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:24.021115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c02d6-b4f1-4aa7-82e2-27ff18ac7304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:24.021466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c02d6-b4f1-4aa7-82e2-27ff18ac7304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:24.023002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c02d6-b4f1-4aa7-82e2-27ff18ac7304 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:24.035668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 478/961] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Nov 2 03:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:24.041475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383a6ad-5043-468b-9d8b-c67dfbe59b08 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:24.076426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:24.140017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383a6ad-5043-468b-9d8b-c67dfbe59b08 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:24.173353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2dcc8-a39f-43ac-8853-0b8012146dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:24.173966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2dcc8-a39f-43ac-8853-0b8012146dbd None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:24.174247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2dcc8-a39f-43ac-8853-0b8012146dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:24.174519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2dcc8-a39f-43ac-8853-0b8012146dbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:24.180878 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2dcc8-a39f-43ac-8853-0b8012146dbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:24.182310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2dcc8-a39f-43ac-8853-0b8012146dbd None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application [None req-83d2dcc8-a39f-43ac-8853-0b8012146dbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 03:24:24.198835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:24.199857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:24.200960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 03:24:24.200960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 03:24:24.200960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 03:24:24.200960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 03:24:24.200960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 03:24:24.200960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 03:24:24.200960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 03:24:24.200960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: ERROR keystone.server.flask.application Nov 02 03:24:24.200960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 484/962] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Nov 2 03:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:24.206533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c02d6-b4f1-4aa7-82e2-27ff18ac7304 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:24.304625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c02d6-b4f1-4aa7-82e2-27ff18ac7304 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:24.337347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8282cbd-0cfc-4949-9611-9b7e1671e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:24.337879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282cbd-0cfc-4949-9611-9b7e1671e0cf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:24.338155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282cbd-0cfc-4949-9611-9b7e1671e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:24.338424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282cbd-0cfc-4949-9611-9b7e1671e0cf None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:24.339104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8282cbd-0cfc-4949-9611-9b7e1671e0cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:24.339409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8282cbd-0cfc-4949-9611-9b7e1671e0cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:24.340841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8282cbd-0cfc-4949-9611-9b7e1671e0cf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:24.352866 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 479/963] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Nov 2 03:24:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:24.358947 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2dcc8-a39f-43ac-8853-0b8012146dbd None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:24.451861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:24.458434 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2dcc8-a39f-43ac-8853-0b8012146dbd None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:24.491839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eef87-452c-46c0-b8e3-ad8018ebf6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:24.492430 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eef87-452c-46c0-b8e3-ad8018ebf6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:24.492747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eef87-452c-46c0-b8e3-ad8018ebf6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:24.493015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eef87-452c-46c0-b8e3-ad8018ebf6a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:24.493720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eef87-452c-46c0-b8e3-ad8018ebf6a5 None admin] RBAC: Adding query filter params (role.id=9a4fa7f48c24440cae54bb4ec26b5b49, scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d, user.id=91b2777a51af45f5a86627d840f5b814) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:24.494021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eef87-452c-46c0-b8e3-ad8018ebf6a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:24.495426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eef87-452c-46c0-b8e3-ad8018ebf6a5 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:24.501883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 485/964] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Nov 2 03:24:24 2022] GET /identity/v3/role_assignments?user.id=91b2777a51af45f5a86627d840f5b814&scope.project.id=d58acd3f17934bdfb90e72c13bc0ef9d&role.id=9a4fa7f48c24440cae54bb4ec26b5b49 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:26.665516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ac68-472c-4d93-afc6-f73ceb27d89b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:26.666048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ac68-472c-4d93-afc6-f73ceb27d89b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:26.666048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ac68-472c-4d93-afc6-f73ceb27d89b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:26.667395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 480/965] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:24:26.672865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cde19-23e6-4d78-b90c-09d8ba5c4f84 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:26.673280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cde19-23e6-4d78-b90c-09d8ba5c4f84 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:26.673421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cde19-23e6-4d78-b90c-09d8ba5c4f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:26.691384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-567cde19-23e6-4d78-b90c-09d8ba5c4f84 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:24:26.692589 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-567cde19-23e6-4d78-b90c-09d8ba5c4f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:24:26.768933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 486/966] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:24:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:24:27.053542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222ac68-472c-4d93-afc6-f73ceb27d89b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:27.084948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:27.154215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222ac68-472c-4d93-afc6-f73ceb27d89b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:27.187146 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b1b94-0840-4d9a-9d49-00d120144c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:27.187803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b1b94-0840-4d9a-9d49-00d120144c3f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:27.188077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b1b94-0840-4d9a-9d49-00d120144c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:27.188347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b1b94-0840-4d9a-9d49-00d120144c3f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:27.188949 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b1b94-0840-4d9a-9d49-00d120144c3f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:27.190287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b1b94-0840-4d9a-9d49-00d120144c3f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-425b1b94-0840-4d9a-9d49-00d120144c3f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:27.198879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:27.200200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:27.201294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 481/967] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Nov 2 03:24:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:27.206566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cde19-23e6-4d78-b90c-09d8ba5c4f84 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:27.293200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:27.303463 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cde19-23e6-4d78-b90c-09d8ba5c4f84 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:27.337636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a06b1d-3685-49b4-8448-720e92bd615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:27.338236 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06b1d-3685-49b4-8448-720e92bd615e None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:27.338517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06b1d-3685-49b4-8448-720e92bd615e None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:27.338790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a06b1d-3685-49b4-8448-720e92bd615e None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:27.339408 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a06b1d-3685-49b4-8448-720e92bd615e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:27.339708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a06b1d-3685-49b4-8448-720e92bd615e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:27.341102 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a06b1d-3685-49b4-8448-720e92bd615e None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:27.346563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 487/968] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Nov 2 03:24:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:27.352191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b1b94-0840-4d9a-9d49-00d120144c3f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:27.442101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:27.447876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b1b94-0840-4d9a-9d49-00d120144c3f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:27.480483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936dc9e-abe3-47aa-a576-e429c68404f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:27.481085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936dc9e-abe3-47aa-a576-e429c68404f1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:27.481362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936dc9e-abe3-47aa-a576-e429c68404f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:27.481628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936dc9e-abe3-47aa-a576-e429c68404f1 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:27.482240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936dc9e-abe3-47aa-a576-e429c68404f1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:27.482537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936dc9e-abe3-47aa-a576-e429c68404f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:27.483871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936dc9e-abe3-47aa-a576-e429c68404f1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:27.488452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 482/969] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Nov 2 03:24:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:29.611597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b1b1-ee73-4c8f-b2cc-90f3b516fc4c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:29.612125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b1b1-ee73-4c8f-b2cc-90f3b516fc4c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:29.612125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b1b1-ee73-4c8f-b2cc-90f3b516fc4c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:29.613582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 488/970] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:24:29.618600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38939e27-e3bf-41b9-b36c-bea8367f0494 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:29.619011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38939e27-e3bf-41b9-b36c-bea8367f0494 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:29.619153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38939e27-e3bf-41b9-b36c-bea8367f0494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:29.637519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-38939e27-e3bf-41b9-b36c-bea8367f0494 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:24:29.638696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-38939e27-e3bf-41b9-b36c-bea8367f0494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:24:29.703720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 483/971] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:24:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:24:29.980438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b1b1-ee73-4c8f-b2cc-90f3b516fc4c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:30.080706 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b1b1-ee73-4c8f-b2cc-90f3b516fc4c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:30.114168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28298fd-582d-44e1-a2af-ec813b452231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:30.114757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28298fd-582d-44e1-a2af-ec813b452231 None admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:30.115036 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28298fd-582d-44e1-a2af-ec813b452231 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:30.115306 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28298fd-582d-44e1-a2af-ec813b452231 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:30.115937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28298fd-582d-44e1-a2af-ec813b452231 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:30.117304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28298fd-582d-44e1-a2af-ec813b452231 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:30.131576 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 489/972] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Nov 2 03:24:29 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:24:32.287956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb559-9765-43fb-99cf-77e2ea369237 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:32.288581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb559-9765-43fb-99cf-77e2ea369237 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:32.288581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb559-9765-43fb-99cf-77e2ea369237 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:32.289842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 484/973] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:24:32.295255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95c88c-84c6-4cb6-95fd-51c92f34c89e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:32.295699 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95c88c-84c6-4cb6-95fd-51c92f34c89e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:32.295811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95c88c-84c6-4cb6-95fd-51c92f34c89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:32.314016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0a95c88c-84c6-4cb6-95fd-51c92f34c89e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:24:32.315177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0a95c88c-84c6-4cb6-95fd-51c92f34c89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:24:32.324201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:32.389194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 490/974] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:24:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:24:32.658141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eb559-9765-43fb-99cf-77e2ea369237 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:32.755228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:32.768668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eb559-9765-43fb-99cf-77e2ea369237 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:32.809064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c22b91-14a7-477e-b7a2-fac4f936311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:32.809684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22b91-14a7-477e-b7a2-fac4f936311a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:32.809958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22b91-14a7-477e-b7a2-fac4f936311a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:32.810227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22b91-14a7-477e-b7a2-fac4f936311a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:32.810797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c22b91-14a7-477e-b7a2-fac4f936311a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:32.812138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c22b91-14a7-477e-b7a2-fac4f936311a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b6c22b91-14a7-477e-b7a2-fac4f936311a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:32.820776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:32.821811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:32.822762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 485/975] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Nov 2 03:24:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:32.827956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95c88c-84c6-4cb6-95fd-51c92f34c89e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:32.926572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95c88c-84c6-4cb6-95fd-51c92f34c89e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:32.958595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c61d59-083b-4dea-924e-afcf9ec5b684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:32.959220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c61d59-083b-4dea-924e-afcf9ec5b684 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:32.959456 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c61d59-083b-4dea-924e-afcf9ec5b684 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:32.959725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c61d59-083b-4dea-924e-afcf9ec5b684 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:32.960355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c61d59-083b-4dea-924e-afcf9ec5b684 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:32.960685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c61d59-083b-4dea-924e-afcf9ec5b684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:32.962055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c61d59-083b-4dea-924e-afcf9ec5b684 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:32.967101 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 491/976] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Nov 2 03:24:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:32.974026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c22b91-14a7-477e-b7a2-fac4f936311a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:33.070973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c22b91-14a7-477e-b7a2-fac4f936311a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:33.103366 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8b8e5-d18b-4f78-87b6-e767d8b0e687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:33.103950 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8b8e5-d18b-4f78-87b6-e767d8b0e687 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:33.104224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8b8e5-d18b-4f78-87b6-e767d8b0e687 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:33.104514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8b8e5-d18b-4f78-87b6-e767d8b0e687 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:33.105197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8b8e5-d18b-4f78-87b6-e767d8b0e687 None admin] RBAC: Adding query filter params (interface=public, service_id=ff0b1f58b6b04d1c8192c85f4bf9b33d, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:33.105499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8b8e5-d18b-4f78-87b6-e767d8b0e687 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:33.106836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8b8e5-d18b-4f78-87b6-e767d8b0e687 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:33.112638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 486/977] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Nov 2 03:24:32 2022] GET /identity/v3/endpoints?service_id=ff0b1f58b6b04d1c8192c85f4bf9b33d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:33.118248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c61d59-083b-4dea-924e-afcf9ec5b684 None admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:33.122014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:33.217032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c61d59-083b-4dea-924e-afcf9ec5b684 None admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:33.250013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007471cf-78ea-4232-ae2e-e0c7367a51f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:33.250605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007471cf-78ea-4232-ae2e-e0c7367a51f9 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:33.250884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007471cf-78ea-4232-ae2e-e0c7367a51f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:33.251160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007471cf-78ea-4232-ae2e-e0c7367a51f9 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:33.251749 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007471cf-78ea-4232-ae2e-e0c7367a51f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:33.253141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007471cf-78ea-4232-ae2e-e0c7367a51f9 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:33.259717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 492/978] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Nov 2 03:24:33 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:24:35.374913 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc73c43-d3d9-4ffd-b132-32c2f505e20a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:35.375406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc73c43-d3d9-4ffd-b132-32c2f505e20a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:35.375406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc73c43-d3d9-4ffd-b132-32c2f505e20a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:35.376861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 487/979] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:24:35.381884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a61be-f57c-407a-8cf5-7213f9218d7f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:35.382278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a61be-f57c-407a-8cf5-7213f9218d7f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:35.382435 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a61be-f57c-407a-8cf5-7213f9218d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:35.400899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8c8a61be-f57c-407a-8cf5-7213f9218d7f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:24:35.402076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8c8a61be-f57c-407a-8cf5-7213f9218d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:24:35.461614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:35.467507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 493/980] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:24:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 03:24:35.737560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc73c43-d3d9-4ffd-b132-32c2f505e20a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:35.760918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:35.853409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc73c43-d3d9-4ffd-b132-32c2f505e20a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:35.887759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2daf8-ced0-426a-bdff-2eb2e5bffd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:35.888385 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2daf8-ced0-426a-bdff-2eb2e5bffd20 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:35.888692 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2daf8-ced0-426a-bdff-2eb2e5bffd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:35.888960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2daf8-ced0-426a-bdff-2eb2e5bffd20 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:35.889531 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2daf8-ced0-426a-bdff-2eb2e5bffd20 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:35.891162 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2daf8-ced0-426a-bdff-2eb2e5bffd20 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b6a2daf8-ced0-426a-bdff-2eb2e5bffd20 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 03:24:35.899829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 03:24:35.901023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Nov 02 03:24:35.902022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 488/981] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Nov 2 03:24:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 03:24:35.907494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a61be-f57c-407a-8cf5-7213f9218d7f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:36.004781 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a61be-f57c-407a-8cf5-7213f9218d7f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:36.038089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96717ffd-feeb-44c0-b0c8-3e8f687c4013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:36.038698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96717ffd-feeb-44c0-b0c8-3e8f687c4013 None admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:36.038963 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96717ffd-feeb-44c0-b0c8-3e8f687c4013 None admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:36.039251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96717ffd-feeb-44c0-b0c8-3e8f687c4013 None admin] PATH_INFO: `/v3/services` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:36.039876 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96717ffd-feeb-44c0-b0c8-3e8f687c4013 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:24:36.040184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96717ffd-feeb-44c0-b0c8-3e8f687c4013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:36.041595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96717ffd-feeb-44c0-b0c8-3e8f687c4013 None admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:36.046913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 494/982] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Nov 2 03:24:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:24:36.052644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2daf8-ced0-426a-bdff-2eb2e5bffd20 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:24:36.132441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:36.149891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2daf8-ced0-426a-bdff-2eb2e5bffd20 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:24:36.181753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2ff72-ad63-4cb3-b802-c8b99bbbdbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:24:36.182351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2ff72-ad63-4cb3-b802-c8b99bbbdbfe None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:24:36.182630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2ff72-ad63-4cb3-b802-c8b99bbbdbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:24:36.182900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2ff72-ad63-4cb3-b802-c8b99bbbdbfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:24:36.183550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2ff72-ad63-4cb3-b802-c8b99bbbdbfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:24:36.184927 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2ff72-ad63-4cb3-b802-c8b99bbbdbfe None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:24:36.203888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 489/983] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:24:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:24:46.044138 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=69 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:24:46.199833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:40.429981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb68e-b223-43e2-a93f-bdb4a6916a2e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:40.430562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb68e-b223-43e2-a93f-bdb4a6916a2e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:40.430562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb68e-b223-43e2-a93f-bdb4a6916a2e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:40.437975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba747538-6cf6-4001-bf7a-bed5658c959a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:40.438449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba747538-6cf6-4001-bf7a-bed5658c959a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:40.438528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba747538-6cf6-4001-bf7a-bed5658c959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:40.443638 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 495/984] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:25:40 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:25:40.531482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ba747538-6cf6-4001-bf7a-bed5658c959a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:25:40.532675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ba747538-6cf6-4001-bf7a-bed5658c959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:40.652826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 490/985] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:25:40.957455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f93ca-ad5b-40d6-9764-f32faf3b16e9 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:40.957798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f93ca-ad5b-40d6-9764-f32faf3b16e9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:40.958014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f93ca-ad5b-40d6-9764-f32faf3b16e9 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:40.959362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 496/986] 10.222.0.20 () {54 vars in 965 bytes} [Wed Nov 2 03:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:25:40.965431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eba030-1fb2-4768-8628-cd0256bc3fc5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:40.965887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eba030-1fb2-4768-8628-cd0256bc3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:40.966284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eba030-1fb2-4768-8628-cd0256bc3fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:41.131674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-65eba030-1fb2-4768-8628-cd0256bc3fc5 None None] MFA Rules not processed for user `aea5fababc0a497686549ed7b9b85c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:25:41.133239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-65eba030-1fb2-4768-8628-cd0256bc3fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:41.163919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:41.227695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 491/987] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Nov 2 03:25:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:25:41.237315 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f93ca-ad5b-40d6-9764-f32faf3b16e9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:25:41.239326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-088f93ca-ad5b-40d6-9764-f32faf3b16e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:41.383734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f93ca-ad5b-40d6-9764-f32faf3b16e9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:25:41.483147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534ef72-8c4f-4670-ac22-c48cd94e7255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:25:41.484998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534ef72-8c4f-4670-ac22-c48cd94e7255 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:41.485521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534ef72-8c4f-4670-ac22-c48cd94e7255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:41.486188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534ef72-8c4f-4670-ac22-c48cd94e7255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:41.488309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2534ef72-8c4f-4670-ac22-c48cd94e7255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:41.565513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:41.637960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534ef72-8c4f-4670-ac22-c48cd94e7255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:25:41.639336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534ef72-8c4f-4670-ac22-c48cd94e7255 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:25:41.672549 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 497/988] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:25:44.187408 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ca482-f758-4d83-a083-170edb49ff56 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:44.187968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ca482-f758-4d83-a083-170edb49ff56 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:44.187968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ca482-f758-4d83-a083-170edb49ff56 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:44.189326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 492/989] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:25:44.194477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec018d-1ea5-4c39-b5b7-2d96f13c7f42 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:44.194880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec018d-1ea5-4c39-b5b7-2d96f13c7f42 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:44.195028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec018d-1ea5-4c39-b5b7-2d96f13c7f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:44.267607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d7ec018d-1ea5-4c39-b5b7-2d96f13c7f42 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:25:44.268915 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d7ec018d-1ea5-4c39-b5b7-2d96f13c7f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:44.369873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 498/990] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:25:44.664241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b2e17-f88e-429b-bb79-6e2a4ba2f6a1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:44.664553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b2e17-f88e-429b-bb79-6e2a4ba2f6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:44.664836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b2e17-f88e-429b-bb79-6e2a4ba2f6a1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:44.666162 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 493/991] 10.222.0.20 () {54 vars in 965 bytes} [Wed Nov 2 03:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:25:44.672800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7bb50-48fb-4548-9647-6f442e48d680 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:44.673090 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7bb50-48fb-4548-9647-6f442e48d680 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:44.673365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7bb50-48fb-4548-9647-6f442e48d680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:44.685634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:44.748728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f0d7bb50-48fb-4548-9647-6f442e48d680 None None] MFA Rules not processed for user `aea5fababc0a497686549ed7b9b85c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:25:44.749918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f0d7bb50-48fb-4548-9647-6f442e48d680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:44.823550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 499/992] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Nov 2 03:25:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:25:44.832629 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b2e17-f88e-429b-bb79-6e2a4ba2f6a1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:25:44.834162 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f01b2e17-f88e-429b-bb79-6e2a4ba2f6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:44.937935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b2e17-f88e-429b-bb79-6e2a4ba2f6a1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:25:45.015291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:45.017778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652cd26-e327-4ad1-9a98-85be39e6de98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:25:45.018552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652cd26-e327-4ad1-9a98-85be39e6de98 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:45.019077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652cd26-e327-4ad1-9a98-85be39e6de98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:45.019579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652cd26-e327-4ad1-9a98-85be39e6de98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:45.021469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e652cd26-e327-4ad1-9a98-85be39e6de98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:45.130374 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652cd26-e327-4ad1-9a98-85be39e6de98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:25:45.131833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652cd26-e327-4ad1-9a98-85be39e6de98 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:25:45.150674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 494/993] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:25:47.825202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6e665-1638-4467-b2f4-c70ec0d29172 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:47.825740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6e665-1638-4467-b2f4-c70ec0d29172 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:47.825740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6e665-1638-4467-b2f4-c70ec0d29172 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:47.827093 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 500/994] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:25:47.832271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348721dd-4e33-466e-a9e3-90da0be27eda None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:47.832737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348721dd-4e33-466e-a9e3-90da0be27eda None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:47.832829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348721dd-4e33-466e-a9e3-90da0be27eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:47.898214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-348721dd-4e33-466e-a9e3-90da0be27eda None None] MFA Rules not processed for user `28d5854b2bc04ea7a32ebadc709ee034`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:25:47.899414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-348721dd-4e33-466e-a9e3-90da0be27eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:47.950747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:47.995086 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 495/995] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:25:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:25:48.279767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6e665-1638-4467-b2f4-c70ec0d29172 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:25:48.281323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dec6e665-1638-4467-b2f4-c70ec0d29172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:48.383494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6e665-1638-4467-b2f4-c70ec0d29172 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:25:48.386277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:48.455845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2df1-0bf3-4d0b-b9c1-577b9c542a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:25:48.456441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2df1-0bf3-4d0b-b9c1-577b9c542a70 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:48.456743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2df1-0bf3-4d0b-b9c1-577b9c542a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:48.457010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2df1-0bf3-4d0b-b9c1-577b9c542a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:48.458573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f34b2df1-0bf3-4d0b-b9c1-577b9c542a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:48.564846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2df1-0bf3-4d0b-b9c1-577b9c542a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:25:48.566192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2df1-0bf3-4d0b-b9c1-577b9c542a70 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:25:48.583507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 501/996] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:25:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:25:51.299708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35d1a-378c-4abd-93f4-f5d967ad1e0c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:51.300215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35d1a-378c-4abd-93f4-f5d967ad1e0c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:51.300215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35d1a-378c-4abd-93f4-f5d967ad1e0c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:51.301545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 496/997] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:25:51.306645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22923b1-f143-46dc-9689-c1cdde4e2603 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:51.307067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22923b1-f143-46dc-9689-c1cdde4e2603 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:51.307193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22923b1-f143-46dc-9689-c1cdde4e2603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:51.348230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:51.375049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f22923b1-f143-46dc-9689-c1cdde4e2603 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:25:51.376266 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f22923b1-f143-46dc-9689-c1cdde4e2603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:51.469747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 502/998] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:25:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:25:51.758438 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a35d1a-378c-4abd-93f4-f5d967ad1e0c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:25:51.759988 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-76a35d1a-378c-4abd-93f4-f5d967ad1e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:51.864016 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a35d1a-378c-4abd-93f4-f5d967ad1e0c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:25:51.936603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca232a8-5101-436a-a36c-571aa5b9017a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:25:51.937210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca232a8-5101-436a-a36c-571aa5b9017a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:51.937496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca232a8-5101-436a-a36c-571aa5b9017a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:51.937773 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca232a8-5101-436a-a36c-571aa5b9017a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:51.939369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dca232a8-5101-436a-a36c-571aa5b9017a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:51.946155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:52.048309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca232a8-5101-436a-a36c-571aa5b9017a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:25:52.049778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca232a8-5101-436a-a36c-571aa5b9017a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:25:52.067464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 497/999] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:25:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:25:54.854759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfd369-4c55-4e97-a35b-6ee163509933 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:54.855393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfd369-4c55-4e97-a35b-6ee163509933 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:54.855482 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfd369-4c55-4e97-a35b-6ee163509933 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:54.856984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 503/1000] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:25:54.862190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971e6a-6f0a-43c7-a947-de311c26e44f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:54.862582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971e6a-6f0a-43c7-a947-de311c26e44f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:54.862734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971e6a-6f0a-43c7-a947-de311c26e44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:54.937254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fd971e6a-6f0a-43c7-a947-de311c26e44f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:25:54.938490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd971e6a-6f0a-43c7-a947-de311c26e44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:55.007334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:55.052412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 498/1001] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:25:55.334159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfd369-4c55-4e97-a35b-6ee163509933 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:25:55.335728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c3dfd369-4c55-4e97-a35b-6ee163509933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:55.441208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfd369-4c55-4e97-a35b-6ee163509933 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:25:55.454569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:55.516906 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d167eb1-8b9f-4e83-8461-015638bc9ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:25:55.517517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d167eb1-8b9f-4e83-8461-015638bc9ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:55.517801 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d167eb1-8b9f-4e83-8461-015638bc9ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:55.518073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d167eb1-8b9f-4e83-8461-015638bc9ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:55.519672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4d167eb1-8b9f-4e83-8461-015638bc9ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:55.640966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d167eb1-8b9f-4e83-8461-015638bc9ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:25:55.642314 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d167eb1-8b9f-4e83-8461-015638bc9ac3 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:25:55.660848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 504/1002] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:25:57.868032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4904c8-bdb1-48b0-8c47-79ad48f55803 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:57.868655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4904c8-bdb1-48b0-8c47-79ad48f55803 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:57.868655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4904c8-bdb1-48b0-8c47-79ad48f55803 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:57.870011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 499/1003] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:25:57.875398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74c2e6-aa8f-4c0f-b672-f3cbc0df93d7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:57.875818 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74c2e6-aa8f-4c0f-b672-f3cbc0df93d7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:57.876014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74c2e6-aa8f-4c0f-b672-f3cbc0df93d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:57.924011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:57.942291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1e74c2e6-aa8f-4c0f-b672-f3cbc0df93d7 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:25:57.943484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1e74c2e6-aa8f-4c0f-b672-f3cbc0df93d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:58.050756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 505/1004] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:25:58.329296 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4904c8-bdb1-48b0-8c47-79ad48f55803 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:25:58.330854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa4904c8-bdb1-48b0-8c47-79ad48f55803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:58.435000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4904c8-bdb1-48b0-8c47-79ad48f55803 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:25:58.509181 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495e11a-003b-4e8c-85b9-fc40b7a20add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:25:58.509786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495e11a-003b-4e8c-85b9-fc40b7a20add service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:25:58.510077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495e11a-003b-4e8c-85b9-fc40b7a20add service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:25:58.510339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495e11a-003b-4e8c-85b9-fc40b7a20add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:25:58.512712 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9495e11a-003b-4e8c-85b9-fc40b7a20add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:25:58.529895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:25:58.624995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495e11a-003b-4e8c-85b9-fc40b7a20add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:25:58.626352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495e11a-003b-4e8c-85b9-fc40b7a20add service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:25:58.644384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 500/1005] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:00.874771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a46c-934e-44ab-a5bf-4d18b96b274a None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:00.875281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a46c-934e-44ab-a5bf-4d18b96b274a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:00.875281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a46c-934e-44ab-a5bf-4d18b96b274a None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:00.876651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 506/1006] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:00.881870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e96c9c-5893-43da-aa31-98fc124a29d8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:00.882264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e96c9c-5893-43da-aa31-98fc124a29d8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:00.882429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e96c9c-5893-43da-aa31-98fc124a29d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:00.949949 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a2e96c9c-5893-43da-aa31-98fc124a29d8 None None] MFA Rules not processed for user `28d5854b2bc04ea7a32ebadc709ee034`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:00.951142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a2e96c9c-5893-43da-aa31-98fc124a29d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:01.015592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:01.047915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 501/1007] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:01.333052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88a46c-934e-44ab-a5bf-4d18b96b274a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:01.334621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-df88a46c-934e-44ab-a5bf-4d18b96b274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:01.441531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88a46c-934e-44ab-a5bf-4d18b96b274a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:01.463247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:01.517839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af90e2-ea85-4f62-812d-a66d5d8accae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:01.518446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af90e2-ea85-4f62-812d-a66d5d8accae service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:01.518728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af90e2-ea85-4f62-812d-a66d5d8accae service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:01.519086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af90e2-ea85-4f62-812d-a66d5d8accae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:01.520727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-59af90e2-ea85-4f62-812d-a66d5d8accae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:01.631838 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af90e2-ea85-4f62-812d-a66d5d8accae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:01.633253 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af90e2-ea85-4f62-812d-a66d5d8accae service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:01.652493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 507/1008] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:04.076138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111e39c-3672-498a-8f14-ed0b9fe0fcc6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:04.076720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111e39c-3672-498a-8f14-ed0b9fe0fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:04.076720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111e39c-3672-498a-8f14-ed0b9fe0fcc6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:04.078059 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 502/1009] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:04.083343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0006e-0be7-4c53-9a1d-e0645af9a243 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:04.083743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0006e-0be7-4c53-9a1d-e0645af9a243 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:04.083895 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0006e-0be7-4c53-9a1d-e0645af9a243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:04.146979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:04.149878 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8dd0006e-0be7-4c53-9a1d-e0645af9a243 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:04.151711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8dd0006e-0be7-4c53-9a1d-e0645af9a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:04.246845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 508/1010] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:04.529963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111e39c-3672-498a-8f14-ed0b9fe0fcc6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:04.531502 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c111e39c-3672-498a-8f14-ed0b9fe0fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:04.634248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111e39c-3672-498a-8f14-ed0b9fe0fcc6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:04.706120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3dde1-3526-47b8-be2e-78841e8a6c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:04.706719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3dde1-3526-47b8-be2e-78841e8a6c03 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:04.706998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3dde1-3526-47b8-be2e-78841e8a6c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:04.707266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3dde1-3526-47b8-be2e-78841e8a6c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:04.708887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e2e3dde1-3526-47b8-be2e-78841e8a6c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:04.736239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:04.819887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3dde1-3526-47b8-be2e-78841e8a6c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:04.821336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3dde1-3526-47b8-be2e-78841e8a6c03 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:04.839473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 503/1011] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:07.019584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6297e1-dcd9-4d67-8c2f-05bfb0a4f34f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:07.020147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6297e1-dcd9-4d67-8c2f-05bfb0a4f34f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:07.020147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6297e1-dcd9-4d67-8c2f-05bfb0a4f34f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:07.021506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 509/1012] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:07.026992 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20091fae-c4cf-4489-9497-29279d0d7ed5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:07.027403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20091fae-c4cf-4489-9497-29279d0d7ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:07.027540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20091fae-c4cf-4489-9497-29279d0d7ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:07.094244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-20091fae-c4cf-4489-9497-29279d0d7ed5 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:07.095454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-20091fae-c4cf-4489-9497-29279d0d7ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:07.169843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:07.192162 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 504/1013] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:07.473956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6297e1-dcd9-4d67-8c2f-05bfb0a4f34f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:07.475526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2f6297e1-dcd9-4d67-8c2f-05bfb0a4f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:07.577634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6297e1-dcd9-4d67-8c2f-05bfb0a4f34f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:07.607096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:07.652781 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b044c-8843-4c41-a0b8-2b72fb96b462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:07.653380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b044c-8843-4c41-a0b8-2b72fb96b462 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:07.653655 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b044c-8843-4c41-a0b8-2b72fb96b462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:07.653924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b044c-8843-4c41-a0b8-2b72fb96b462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:07.655496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2c0b044c-8843-4c41-a0b8-2b72fb96b462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:07.765497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b044c-8843-4c41-a0b8-2b72fb96b462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:07.766932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b044c-8843-4c41-a0b8-2b72fb96b462 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:07.785751 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 510/1014] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:10.263029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be0e3-b6d4-42da-95f4-bfbd63a516f5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:10.263595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be0e3-b6d4-42da-95f4-bfbd63a516f5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:10.263595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be0e3-b6d4-42da-95f4-bfbd63a516f5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:10.264960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 505/1015] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:10.270144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24168-5359-4241-ba98-26633d2e3845 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:10.270567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24168-5359-4241-ba98-26633d2e3845 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:10.270702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24168-5359-4241-ba98-26633d2e3845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:10.336661 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-aec24168-5359-4241-ba98-26633d2e3845 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:10.337870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aec24168-5359-4241-ba98-26633d2e3845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:10.346882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:10.435149 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 511/1016] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:10.716993 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be0e3-b6d4-42da-95f4-bfbd63a516f5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:10.718517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-967be0e3-b6d4-42da-95f4-bfbd63a516f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:10.821440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be0e3-b6d4-42da-95f4-bfbd63a516f5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:10.896476 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbeae17-2635-4e77-a3a8-e95aa3b21cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:10.897106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeae17-2635-4e77-a3a8-e95aa3b21cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:10.897389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeae17-2635-4e77-a3a8-e95aa3b21cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:10.897670 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeae17-2635-4e77-a3a8-e95aa3b21cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:10.899275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7bbeae17-2635-4e77-a3a8-e95aa3b21cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:10.935539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:11.013383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbeae17-2635-4e77-a3a8-e95aa3b21cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:11.014820 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbeae17-2635-4e77-a3a8-e95aa3b21cb3 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:11.033222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 506/1017] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:15.225423 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71ef8a-3ded-40e2-9fc6-97e511807532 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:15.225929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71ef8a-3ded-40e2-9fc6-97e511807532 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:15.225929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71ef8a-3ded-40e2-9fc6-97e511807532 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:15.227247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 512/1018] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:15.233096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f0b7-648e-4a20-b777-3cde415c81b4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:15.233795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f0b7-648e-4a20-b777-3cde415c81b4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:15.234029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f0b7-648e-4a20-b777-3cde415c81b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:15.305378 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9ec6f0b7-648e-4a20-b777-3cde415c81b4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:15.306588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9ec6f0b7-648e-4a20-b777-3cde415c81b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:15.396665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:15.408969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 507/1019] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:15.711567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71ef8a-3ded-40e2-9fc6-97e511807532 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:15.713667 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ec71ef8a-3ded-40e2-9fc6-97e511807532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:15.819532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71ef8a-3ded-40e2-9fc6-97e511807532 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:15.858937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:15.896267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e1e23-330d-429c-a251-47a4b4c8c297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:15.896903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e1e23-330d-429c-a251-47a4b4c8c297 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:15.897184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e1e23-330d-429c-a251-47a4b4c8c297 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:15.897453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e1e23-330d-429c-a251-47a4b4c8c297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:15.899050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-623e1e23-330d-429c-a251-47a4b4c8c297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:16.007987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e1e23-330d-429c-a251-47a4b4c8c297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:16.009364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e1e23-330d-429c-a251-47a4b4c8c297 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:16.029009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 513/1020] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:18.843720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbcca4-ac3d-4019-86e5-c74d27734a89 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:18.844290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbcca4-ac3d-4019-86e5-c74d27734a89 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:18.844290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbcca4-ac3d-4019-86e5-c74d27734a89 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:18.845626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 508/1021] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:18.850809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fccc1-2b16-4402-b000-61ae53c9509a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:18.851217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fccc1-2b16-4402-b000-61ae53c9509a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:18.851358 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fccc1-2b16-4402-b000-61ae53c9509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:18.918273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e03fccc1-2b16-4402-b000-61ae53c9509a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:18.919471 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e03fccc1-2b16-4402-b000-61ae53c9509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:18.937868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:19.019158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 514/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:19.307618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbcca4-ac3d-4019-86e5-c74d27734a89 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:19.309375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bbbbcca4-ac3d-4019-86e5-c74d27734a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:19.418522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbcca4-ac3d-4019-86e5-c74d27734a89 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:19.492108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2b2c1-e686-4195-94f9-5b29c3a602aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:19.492662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2b2c1-e686-4195-94f9-5b29c3a602aa service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:19.492949 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2b2c1-e686-4195-94f9-5b29c3a602aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:19.493220 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2b2c1-e686-4195-94f9-5b29c3a602aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:19.495352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3ab2b2c1-e686-4195-94f9-5b29c3a602aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:19.543081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:19.612645 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2b2c1-e686-4195-94f9-5b29c3a602aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:19.614074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2b2c1-e686-4195-94f9-5b29c3a602aa service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:19.633438 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 509/1023] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:23.927695 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820e472-8e75-4d3b-af3c-c3b60e2c0575 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:23.928179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820e472-8e75-4d3b-af3c-c3b60e2c0575 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:23.928284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820e472-8e75-4d3b-af3c-c3b60e2c0575 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:23.929665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 515/1024] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:23.935763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808a44b-95b9-47d1-a114-ec389d015903 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:23.936169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808a44b-95b9-47d1-a114-ec389d015903 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:23.936317 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808a44b-95b9-47d1-a114-ec389d015903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:24.003876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5808a44b-95b9-47d1-a114-ec389d015903 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:24.005095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5808a44b-95b9-47d1-a114-ec389d015903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:24.105732 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:24.107925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 510/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:24.395239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820e472-8e75-4d3b-af3c-c3b60e2c0575 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:24.396968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c820e472-8e75-4d3b-af3c-c3b60e2c0575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:24.503843 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820e472-8e75-4d3b-af3c-c3b60e2c0575 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:24.558298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:24.585147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c415f8-0258-4d08-9036-4c695a84d37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:24.585855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c415f8-0258-4d08-9036-4c695a84d37a service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:24.586144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c415f8-0258-4d08-9036-4c695a84d37a service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:24.586420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c415f8-0258-4d08-9036-4c695a84d37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:24.588637 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-08c415f8-0258-4d08-9036-4c695a84d37a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:24.700510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c415f8-0258-4d08-9036-4c695a84d37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:24.701850 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c415f8-0258-4d08-9036-4c695a84d37a service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:24.719345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 516/1026] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:29.646318 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d24bf8-4fc6-4697-96d0-a6b1a87454e0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:29.647165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d24bf8-4fc6-4697-96d0-a6b1a87454e0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:29.648153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d24bf8-4fc6-4697-96d0-a6b1a87454e0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:29.650296 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 511/1027] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:26:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:29.655601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6cdb-f486-4d19-a457-7314210c4b73 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:29.656376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6cdb-f486-4d19-a457-7314210c4b73 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:29.656835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6cdb-f486-4d19-a457-7314210c4b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:29.770385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f12e6cdb-f486-4d19-a457-7314210c4b73 None None] MFA Rules not processed for user `91b2777a51af45f5a86627d840f5b814`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:29.771364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f12e6cdb-f486-4d19-a457-7314210c4b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:29.825526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:29.928634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 517/1028] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:26:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:34.016496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec510-b4a0-4ec0-8022-0abaf635b123 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:34.017130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec510-b4a0-4ec0-8022-0abaf635b123 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:34.017130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec510-b4a0-4ec0-8022-0abaf635b123 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:34.018482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 512/1029] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:34.023684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931a4f9-484a-45ae-9062-dfdb1bf8b485 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:34.024101 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931a4f9-484a-45ae-9062-dfdb1bf8b485 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:34.024355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931a4f9-484a-45ae-9062-dfdb1bf8b485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:34.103959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9931a4f9-484a-45ae-9062-dfdb1bf8b485 None None] MFA Rules not processed for user `91b2777a51af45f5a86627d840f5b814`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:34.105248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9931a4f9-484a-45ae-9062-dfdb1bf8b485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:34.183972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:34.221651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 518/1030] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:26:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:35.724930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dac3a0-01ca-4da9-8f28-efa187e29de6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:35.725462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dac3a0-01ca-4da9-8f28-efa187e29de6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:35.725462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dac3a0-01ca-4da9-8f28-efa187e29de6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:35.726778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 513/1031] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:35.732680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ffac1-e189-42f6-a188-8f5e0299a19c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:35.733396 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ffac1-e189-42f6-a188-8f5e0299a19c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:35.733501 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ffac1-e189-42f6-a188-8f5e0299a19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:35.812192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-705ffac1-e189-42f6-a188-8f5e0299a19c None None] MFA Rules not processed for user `91b2777a51af45f5a86627d840f5b814`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:35.813427 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-705ffac1-e189-42f6-a188-8f5e0299a19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:35.920033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 519/1032] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:26:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:39.514986 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ec5a-b96a-4c92-bc68-78f35a2f2450 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:39.515516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ec5a-b96a-4c92-bc68-78f35a2f2450 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:39.515766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ec5a-b96a-4c92-bc68-78f35a2f2450 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:39.526083 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 514/1033] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:39.528046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d495850-b876-4a0b-a520-c25c1593bd29 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:39.528983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d495850-b876-4a0b-a520-c25c1593bd29 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:39.529265 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d495850-b876-4a0b-a520-c25c1593bd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:39.575007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:39.611690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2d495850-b876-4a0b-a520-c25c1593bd29 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:39.613160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2d495850-b876-4a0b-a520-c25c1593bd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:39.726470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 520/1034] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:40.034947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d783df5-975d-44df-b2b9-b285d8f89b53 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:40.035519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d783df5-975d-44df-b2b9-b285d8f89b53 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:40.036094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d783df5-975d-44df-b2b9-b285d8f89b53 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:40.038401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 515/1035] 10.222.0.20 () {54 vars in 961 bytes} [Wed Nov 2 03:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:40.055651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e9c53-fd4e-4049-8622-b51ec66e8138 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:40.056479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e9c53-fd4e-4049-8622-b51ec66e8138 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:40.057228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e9c53-fd4e-4049-8622-b51ec66e8138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:40.141920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-214e9c53-fd4e-4049-8622-b51ec66e8138 None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:40.143119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-214e9c53-fd4e-4049-8622-b51ec66e8138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:40.201526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:40.276202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 521/1036] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Nov 2 03:26:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:40.284010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d783df5-975d-44df-b2b9-b285d8f89b53 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:40.285745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7d783df5-975d-44df-b2b9-b285d8f89b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:40.454087 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d783df5-975d-44df-b2b9-b285d8f89b53 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:40.534136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:40.583069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bced2e-f218-4953-916f-e66d274b36df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:40.583842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bced2e-f218-4953-916f-e66d274b36df service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:40.584230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bced2e-f218-4953-916f-e66d274b36df service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:40.584812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bced2e-f218-4953-916f-e66d274b36df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:40.586537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e1bced2e-f218-4953-916f-e66d274b36df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:40.695753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bced2e-f218-4953-916f-e66d274b36df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:40.698225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bced2e-f218-4953-916f-e66d274b36df service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:40.718432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 516/1037] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:43.142830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931702-62ec-4fc6-b886-db6d7f593bfc None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:43.143399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931702-62ec-4fc6-b886-db6d7f593bfc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:43.143399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931702-62ec-4fc6-b886-db6d7f593bfc None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:43.144766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 522/1038] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:43.150871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e8ac-39dc-4e87-86f3-a9011e65c269 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:43.151334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e8ac-39dc-4e87-86f3-a9011e65c269 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:43.151838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e8ac-39dc-4e87-86f3-a9011e65c269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:43.224924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7945e8ac-39dc-4e87-86f3-a9011e65c269 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:43.226156 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7945e8ac-39dc-4e87-86f3-a9011e65c269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:43.268515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:43.335713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 517/1039] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:43.635949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d931702-62ec-4fc6-b886-db6d7f593bfc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:43.637758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3d931702-62ec-4fc6-b886-db6d7f593bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:43.848156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d931702-62ec-4fc6-b886-db6d7f593bfc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:43.858531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:43.970458 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4180be8-21f4-40df-8fe6-1c23a7f0dc1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:43.971066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4180be8-21f4-40df-8fe6-1c23a7f0dc1d service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:43.971344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4180be8-21f4-40df-8fe6-1c23a7f0dc1d service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:43.971619 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4180be8-21f4-40df-8fe6-1c23a7f0dc1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:43.973265 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a4180be8-21f4-40df-8fe6-1c23a7f0dc1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:44.070087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4180be8-21f4-40df-8fe6-1c23a7f0dc1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:44.071806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4180be8-21f4-40df-8fe6-1c23a7f0dc1d service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:44.091857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 523/1040] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:46.590165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f155c-a994-4ccf-8468-e74578067363 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:46.590688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f155c-a994-4ccf-8468-e74578067363 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:46.590688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f155c-a994-4ccf-8468-e74578067363 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:46.592046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 518/1041] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:46.597428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60a53-e7b1-4e8f-bbe7-188df610fe29 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:46.597925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60a53-e7b1-4e8f-bbe7-188df610fe29 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:46.597925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60a53-e7b1-4e8f-bbe7-188df610fe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:46.614504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:46.670191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c5f60a53-e7b1-4e8f-bbe7-188df610fe29 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:46.671587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c5f60a53-e7b1-4e8f-bbe7-188df610fe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:46.778288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 524/1042] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:47.078486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbf7ab-4f0d-426f-bf1f-31560e02c64d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:47.078768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbf7ab-4f0d-426f-bf1f-31560e02c64d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:47.079051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbf7ab-4f0d-426f-bf1f-31560e02c64d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:47.080515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 519/1043] 10.222.0.20 () {54 vars in 961 bytes} [Wed Nov 2 03:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:47.085876 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b496d-4765-4bdd-8472-161646f7d6dd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:47.086287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b496d-4765-4bdd-8472-161646f7d6dd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:47.087769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b496d-4765-4bdd-8472-161646f7d6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:47.168493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-458b496d-4765-4bdd-8472-161646f7d6dd None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:47.169847 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-458b496d-4765-4bdd-8472-161646f7d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:47.207110 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:47.295404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 525/1044] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Nov 2 03:26:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:47.303487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbf7ab-4f0d-426f-bf1f-31560e02c64d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:47.305183 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f6bbf7ab-4f0d-426f-bf1f-31560e02c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:47.463784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbf7ab-4f0d-426f-bf1f-31560e02c64d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:47.488194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:47.588865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f1309-8683-4867-99d9-ecef94b07dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:47.589507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f1309-8683-4867-99d9-ecef94b07dbb service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:47.589862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f1309-8683-4867-99d9-ecef94b07dbb service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:47.590214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f1309-8683-4867-99d9-ecef94b07dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:47.591904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e85f1309-8683-4867-99d9-ecef94b07dbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:47.698168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f1309-8683-4867-99d9-ecef94b07dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:47.699889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f1309-8683-4867-99d9-ecef94b07dbb service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:47.720217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 520/1045] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:47.760325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b7d3b-680b-49bf-ae6b-87138ef703f7 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:47.760938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b7d3b-680b-49bf-ae6b-87138ef703f7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:47.761039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b7d3b-680b-49bf-ae6b-87138ef703f7 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:47.762384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 526/1046] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:47.767988 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cd8d6-5f6f-4095-80ea-827d33970658 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:47.768485 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cd8d6-5f6f-4095-80ea-827d33970658 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:47.768786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cd8d6-5f6f-4095-80ea-827d33970658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:47.823516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:47.879635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4c5cd8d6-5f6f-4095-80ea-827d33970658 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:47.881350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4c5cd8d6-5f6f-4095-80ea-827d33970658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:48.009952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 521/1047] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:26:48.306465 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cdfb7-228b-4878-be18-1132a2a9a79e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:48.306756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cdfb7-228b-4878-be18-1132a2a9a79e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:48.307033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cdfb7-228b-4878-be18-1132a2a9a79e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:48.308543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 527/1048] 10.222.0.20 () {54 vars in 963 bytes} [Wed Nov 2 03:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:48.313304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed00fa-2de9-446a-b721-1a60aedbb620 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:48.313696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed00fa-2de9-446a-b721-1a60aedbb620 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:48.314069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed00fa-2de9-446a-b721-1a60aedbb620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:48.407973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fbed00fa-2de9-446a-b721-1a60aedbb620 None None] MFA Rules not processed for user `de29056c157e47a49e55a75fb0792dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:48.409535 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fbed00fa-2de9-446a-b721-1a60aedbb620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:48.461084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:48.496436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 522/1049] 10.222.0.20 () {58 vars in 1060 bytes} [Wed Nov 2 03:26:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:48.503980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cdfb7-228b-4878-be18-1132a2a9a79e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:48.505646 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-597cdfb7-228b-4878-be18-1132a2a9a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:48.624116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cdfb7-228b-4878-be18-1132a2a9a79e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:48.671284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:48.719091 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf392f4-1fdb-480f-9295-edbd311b0e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:48.719909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf392f4-1fdb-480f-9295-edbd311b0e58 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:48.720272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf392f4-1fdb-480f-9295-edbd311b0e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:48.720775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf392f4-1fdb-480f-9295-edbd311b0e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:48.722628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dbf392f4-1fdb-480f-9295-edbd311b0e58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:48.875589 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf392f4-1fdb-480f-9295-edbd311b0e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:48.877802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf392f4-1fdb-480f-9295-edbd311b0e58 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:48.908242 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 528/1050] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:49.986020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5c64-4e8c-4bd4-bdde-8962535115c0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:49.986580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5c64-4e8c-4bd4-bdde-8962535115c0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:49.986580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5c64-4e8c-4bd4-bdde-8962535115c0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:49.987947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 523/1051] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:49.994659 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499c036-e7e3-4729-8a55-c71715941dbb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:49.995072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499c036-e7e3-4729-8a55-c71715941dbb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:49.995216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499c036-e7e3-4729-8a55-c71715941dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:50.066517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5499c036-e7e3-4729-8a55-c71715941dbb None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:50.067735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5499c036-e7e3-4729-8a55-c71715941dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:50.090245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:50.167597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 529/1052] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:50.470824 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc5c64-4e8c-4bd4-bdde-8962535115c0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:50.472742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-75bc5c64-4e8c-4bd4-bdde-8962535115c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:50.632772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc5c64-4e8c-4bd4-bdde-8962535115c0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:50.686550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:50.753456 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e80645-c9fb-4761-9f29-457a964daf50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:50.754064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e80645-c9fb-4761-9f29-457a964daf50 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:50.754345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e80645-c9fb-4761-9f29-457a964daf50 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:50.754617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e80645-c9fb-4761-9f29-457a964daf50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:50.756217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d6e80645-c9fb-4761-9f29-457a964daf50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:50.849234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e80645-c9fb-4761-9f29-457a964daf50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:50.850822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e80645-c9fb-4761-9f29-457a964daf50 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:50.871204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 524/1053] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:53.114799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d33fe-a356-455d-b337-a4341c0389bf None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:53.115339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d33fe-a356-455d-b337-a4341c0389bf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:53.115339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d33fe-a356-455d-b337-a4341c0389bf None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:53.116857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 530/1054] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:53.122197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac09e-0d55-4e67-90c1-4a43d3819bd6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:53.122623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac09e-0d55-4e67-90c1-4a43d3819bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:53.122803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac09e-0d55-4e67-90c1-4a43d3819bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:53.191708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-07fac09e-0d55-4e67-90c1-4a43d3819bd6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:53.192942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-07fac09e-0d55-4e67-90c1-4a43d3819bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:53.201328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:53.304039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 525/1055] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:53.605738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d33fe-a356-455d-b337-a4341c0389bf None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:53.608010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9b8d33fe-a356-455d-b337-a4341c0389bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:53.767107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d33fe-a356-455d-b337-a4341c0389bf None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:53.771475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:53.892387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87596fa5-b926-45ce-94b6-d24c186d659c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:53.892935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87596fa5-b926-45ce-94b6-d24c186d659c service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:53.893220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87596fa5-b926-45ce-94b6-d24c186d659c service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:53.893495 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87596fa5-b926-45ce-94b6-d24c186d659c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:53.895080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-87596fa5-b926-45ce-94b6-d24c186d659c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:53.991424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87596fa5-b926-45ce-94b6-d24c186d659c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:53.994188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87596fa5-b926-45ce-94b6-d24c186d659c service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:54.014776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 531/1056] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:56.245635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe87f-4a36-4392-a0a9-989240e86b3a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:56.246157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe87f-4a36-4392-a0a9-989240e86b3a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:56.246157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe87f-4a36-4392-a0a9-989240e86b3a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:56.247745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 526/1057] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:56.253139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48387-c95f-41ee-afba-59cf726aebc6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:56.253597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48387-c95f-41ee-afba-59cf726aebc6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:56.253758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48387-c95f-41ee-afba-59cf726aebc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:56.266677 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:56.326419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7cd48387-c95f-41ee-afba-59cf726aebc6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:56.327769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7cd48387-c95f-41ee-afba-59cf726aebc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:56.494732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 532/1058] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:56.788156 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe87f-4a36-4392-a0a9-989240e86b3a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:56.790377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e14fe87f-4a36-4392-a0a9-989240e86b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:56.943775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:56.959133 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe87f-4a36-4392-a0a9-989240e86b3a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:26:57.105221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb9e3f-25cf-40b8-aaa1-37724d2784c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:26:57.105989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb9e3f-25cf-40b8-aaa1-37724d2784c8 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:57.106419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb9e3f-25cf-40b8-aaa1-37724d2784c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:57.106780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb9e3f-25cf-40b8-aaa1-37724d2784c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:57.109678 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-22bb9e3f-25cf-40b8-aaa1-37724d2784c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:57.228246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb9e3f-25cf-40b8-aaa1-37724d2784c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:26:57.229897 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb9e3f-25cf-40b8-aaa1-37724d2784c8 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:26:57.240514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:26:57.249238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 527/1059] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:26:59.440565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe7fd3-f3e5-4b53-8c6a-5d2a64a33c73 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:59.441074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe7fd3-f3e5-4b53-8c6a-5d2a64a33c73 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:59.441074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe7fd3-f3e5-4b53-8c6a-5d2a64a33c73 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:59.442367 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 533/1060] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:26:59.448827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f1686-a47f-4486-b4c6-dfb9b9b90ea6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:26:59.449281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f1686-a47f-4486-b4c6-dfb9b9b90ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:26:59.449577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f1686-a47f-4486-b4c6-dfb9b9b90ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:26:59.533171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-494f1686-a47f-4486-b4c6-dfb9b9b90ea6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:26:59.534567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-494f1686-a47f-4486-b4c6-dfb9b9b90ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:26:59.638908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 528/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:26:59.932525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe7fd3-f3e5-4b53-8c6a-5d2a64a33c73 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:26:59.934061 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c7fe7fd3-f3e5-4b53-8c6a-5d2a64a33c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:00.022853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:00.107470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe7fd3-f3e5-4b53-8c6a-5d2a64a33c73 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:00.226270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7df2e0-b9c9-4219-8ec9-2aea7f2a8aa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:00.226905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7df2e0-b9c9-4219-8ec9-2aea7f2a8aa7 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:00.227183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7df2e0-b9c9-4219-8ec9-2aea7f2a8aa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:00.227491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7df2e0-b9c9-4219-8ec9-2aea7f2a8aa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:00.229088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dc7df2e0-b9c9-4219-8ec9-2aea7f2a8aa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:00.280644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:00.319543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7df2e0-b9c9-4219-8ec9-2aea7f2a8aa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:00.321814 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7df2e0-b9c9-4219-8ec9-2aea7f2a8aa7 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:00.340491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 534/1062] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:02.596696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2cb47-ef17-4b29-b179-080658ca176f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:02.597221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2cb47-ef17-4b29-b179-080658ca176f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:02.597221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2cb47-ef17-4b29-b179-080658ca176f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:02.598579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 529/1063] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:02.603981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1a6e-5cce-4f43-9abe-e7a969b8d07e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:02.604416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1a6e-5cce-4f43-9abe-e7a969b8d07e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:02.604542 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1a6e-5cce-4f43-9abe-e7a969b8d07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:02.670687 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-791f1a6e-5cce-4f43-9abe-e7a969b8d07e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:02.671785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-791f1a6e-5cce-4f43-9abe-e7a969b8d07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:02.767882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 535/1064] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:03.060595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2cb47-ef17-4b29-b179-080658ca176f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:03.062121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-72c2cb47-ef17-4b29-b179-080658ca176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:03.138776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:03.207090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2cb47-ef17-4b29-b179-080658ca176f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:03.318756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19facac6-fe30-4d78-b691-e26dcb7120a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:03.319278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facac6-fe30-4d78-b691-e26dcb7120a5 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:03.319557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facac6-fe30-4d78-b691-e26dcb7120a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:03.319828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facac6-fe30-4d78-b691-e26dcb7120a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:03.322112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19facac6-fe30-4d78-b691-e26dcb7120a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:03.361784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:03.415526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19facac6-fe30-4d78-b691-e26dcb7120a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:03.417138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19facac6-fe30-4d78-b691-e26dcb7120a5 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:03.434861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 530/1065] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:04.272136 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264f0c5-e143-4645-8b88-d47b7cc5a152 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:04.272766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264f0c5-e143-4645-8b88-d47b7cc5a152 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:04.272766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264f0c5-e143-4645-8b88-d47b7cc5a152 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:04.274779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 536/1066] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:04.280166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842c15c-2d66-4d9f-9df4-2c9f93e0b2bb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:04.280656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842c15c-2d66-4d9f-9df4-2c9f93e0b2bb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:04.280829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842c15c-2d66-4d9f-9df4-2c9f93e0b2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:04.347639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2842c15c-2d66-4d9f-9df4-2c9f93e0b2bb None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:04.348832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2842c15c-2d66-4d9f-9df4-2c9f93e0b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:04.460742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 531/1067] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:04.768266 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bc965-9cf5-4cb4-b0a8-bbf8ac5781da None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:04.768585 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bc965-9cf5-4cb4-b0a8-bbf8ac5781da None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:04.768866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bc965-9cf5-4cb4-b0a8-bbf8ac5781da None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:04.770206 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 537/1068] 10.222.0.20 () {54 vars in 962 bytes} [Wed Nov 2 03:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:04.775719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501ae23-dc57-4110-b0b9-a3a41de4722f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:04.776009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501ae23-dc57-4110-b0b9-a3a41de4722f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:04.776288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501ae23-dc57-4110-b0b9-a3a41de4722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:04.792568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:04.855041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c501ae23-dc57-4110-b0b9-a3a41de4722f None None] MFA Rules not processed for user `4b71b778b0b24cbb92446070934d68ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:04.856248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c501ae23-dc57-4110-b0b9-a3a41de4722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:04.933898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 532/1069] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Nov 2 03:27:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:04.941432 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bc965-9cf5-4cb4-b0a8-bbf8ac5781da None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:04.943045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-865bc965-9cf5-4cb4-b0a8-bbf8ac5781da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:04.974042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:05.053901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bc965-9cf5-4cb4-b0a8-bbf8ac5781da None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:05.130871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37cc47-c213-40a1-8883-b784d2836137 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b71b778b0b24cbb92446070934d68ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:05.131482 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37cc47-c213-40a1-8883-b784d2836137 service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:05.131762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37cc47-c213-40a1-8883-b784d2836137 service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:05.132034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37cc47-c213-40a1-8883-b784d2836137 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:05.133748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ff37cc47-c213-40a1-8883-b784d2836137 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:05.214382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:05.247255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37cc47-c213-40a1-8883-b784d2836137 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:05.248718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37cc47-c213-40a1-8883-b784d2836137 service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:05.267049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 538/1070] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:05.657263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d7827-fc0b-4804-8e0f-5b515881a0f0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:05.657743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d7827-fc0b-4804-8e0f-5b515881a0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:05.657850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d7827-fc0b-4804-8e0f-5b515881a0f0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:05.663229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 533/1071] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:05.665962 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e389-272e-4adf-bb06-b6343931aea3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:05.666426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e389-272e-4adf-bb06-b6343931aea3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:05.666516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e389-272e-4adf-bb06-b6343931aea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:05.739165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b9d5e389-272e-4adf-bb06-b6343931aea3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:05.740366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b9d5e389-272e-4adf-bb06-b6343931aea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:05.846646 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 539/1072] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:06.027664 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90795d-fbd0-499d-8151-01d3b95af520 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:06.027952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90795d-fbd0-499d-8151-01d3b95af520 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:06.028233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90795d-fbd0-499d-8151-01d3b95af520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:06.097514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ab90795d-fbd0-499d-8151-01d3b95af520 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:06.098725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ab90795d-fbd0-499d-8151-01d3b95af520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:06.155050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:06.157564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5e389-272e-4adf-bb06-b6343931aea3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:06.158822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b9d5e389-272e-4adf-bb06-b6343931aea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:06.189017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 534/1073] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:27:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:06.200353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:06.233652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d042e-1f60-499a-a5eb-b6b3094740f1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:06.233948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d042e-1f60-499a-a5eb-b6b3094740f1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:06.234226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d042e-1f60-499a-a5eb-b6b3094740f1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:06.235565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 535/1074] 10.222.0.20 () {54 vars in 943 bytes} [Wed Nov 2 03:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:27:06.241390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90f78e-df78-496f-9801-e41ac25b55e4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:06.241675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90f78e-df78-496f-9801-e41ac25b55e4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:06.242656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90f78e-df78-496f-9801-e41ac25b55e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:06.279673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5e389-272e-4adf-bb06-b6343931aea3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:06.319785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2f90f78e-df78-496f-9801-e41ac25b55e4 None None] MFA Rules not processed for user `89782ff12f5c49da80c7568ccab38c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:06.321133 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2f90f78e-df78-496f-9801-e41ac25b55e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:06.399948 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142e177-45b8-4a68-a0da-eaa0708559d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:06.400601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142e177-45b8-4a68-a0da-eaa0708559d7 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:06.400883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142e177-45b8-4a68-a0da-eaa0708559d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:06.401159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142e177-45b8-4a68-a0da-eaa0708559d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:06.402832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c142e177-45b8-4a68-a0da-eaa0708559d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:06.447114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:06.455437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 536/1075] 10.222.0.20 () {58 vars in 1040 bytes} [Wed Nov 2 03:27:06 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:27:06.465676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90f78e-df78-496f-9801-e41ac25b55e4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:06.475724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90f78e-df78-496f-9801-e41ac25b55e4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:06.504856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:06.518599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142e177-45b8-4a68-a0da-eaa0708559d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:06.520416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142e177-45b8-4a68-a0da-eaa0708559d7 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:06.543966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 540/1076] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:06.598622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6aaf9-0dcc-4f75-8ef3-99113b3ddf39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:06.599235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6aaf9-0dcc-4f75-8ef3-99113b3ddf39 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:06.599511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6aaf9-0dcc-4f75-8ef3-99113b3ddf39 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:06.599784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6aaf9-0dcc-4f75-8ef3-99113b3ddf39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:06.601577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-58b6aaf9-0dcc-4f75-8ef3-99113b3ddf39 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:06.713207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6aaf9-0dcc-4f75-8ef3-99113b3ddf39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:06.714837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6aaf9-0dcc-4f75-8ef3-99113b3ddf39 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:06.723880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 537/1077] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:27:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 03:27:08.818268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fb1b5-0786-4aad-a981-5d619d3814c6 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:08.818877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fb1b5-0786-4aad-a981-5d619d3814c6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:08.818877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fb1b5-0786-4aad-a981-5d619d3814c6 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:08.820216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 541/1078] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:08.825598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd403-a0bc-4a7e-bdde-a7a9bde52049 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:08.826052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd403-a0bc-4a7e-bdde-a7a9bde52049 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:08.826142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd403-a0bc-4a7e-bdde-a7a9bde52049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:08.898539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7d5dd403-a0bc-4a7e-bdde-a7a9bde52049 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:08.899768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7d5dd403-a0bc-4a7e-bdde-a7a9bde52049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:08.906678 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:09.007209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 538/1079] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:09.298106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fb1b5-0786-4aad-a981-5d619d3814c6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:09.299699 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-556fb1b5-0786-4aad-a981-5d619d3814c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:09.468172 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fb1b5-0786-4aad-a981-5d619d3814c6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:09.481899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:09.602382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ef7c0-8798-4546-93b5-d29bc2d1fb3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:09.602902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef7c0-8798-4546-93b5-d29bc2d1fb3e service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:09.603183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef7c0-8798-4546-93b5-d29bc2d1fb3e service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:09.603473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef7c0-8798-4546-93b5-d29bc2d1fb3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:09.605195 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5e7ef7c0-8798-4546-93b5-d29bc2d1fb3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:09.716740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ef7c0-8798-4546-93b5-d29bc2d1fb3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:09.718328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ef7c0-8798-4546-93b5-d29bc2d1fb3e service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:09.738704 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 542/1080] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:12.049745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e66c05-6976-45c8-9968-7bb8c202c384 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:12.050226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e66c05-6976-45c8-9968-7bb8c202c384 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:12.050317 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e66c05-6976-45c8-9968-7bb8c202c384 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:12.056136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 539/1081] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:27:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:12.057556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfb12-e02c-4ab2-872a-3df26e425a9f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:12.057982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfb12-e02c-4ab2-872a-3df26e425a9f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:12.058086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfb12-e02c-4ab2-872a-3df26e425a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:12.082119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:12.133555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e2ecfb12-e02c-4ab2-872a-3df26e425a9f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:12.135053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e2ecfb12-e02c-4ab2-872a-3df26e425a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:12.248411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 543/1082] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:12.551865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e66c05-6976-45c8-9968-7bb8c202c384 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:12.553543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e8e66c05-6976-45c8-9968-7bb8c202c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:12.730969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:12.743589 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e66c05-6976-45c8-9968-7bb8c202c384 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:12.874316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458a99a-93d6-4959-a498-b8e9e6854b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:12.875200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458a99a-93d6-4959-a498-b8e9e6854b75 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:12.875487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458a99a-93d6-4959-a498-b8e9e6854b75 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:12.875789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458a99a-93d6-4959-a498-b8e9e6854b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:12.877425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6458a99a-93d6-4959-a498-b8e9e6854b75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:12.982037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458a99a-93d6-4959-a498-b8e9e6854b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:12.984203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458a99a-93d6-4959-a498-b8e9e6854b75 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:12.995959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:13.008639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 540/1083] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:15.230403 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b1c50-3fb0-41e5-a7e4-0fa95ab5eae1 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:15.230935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b1c50-3fb0-41e5-a7e4-0fa95ab5eae1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:15.230935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b1c50-3fb0-41e5-a7e4-0fa95ab5eae1 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:15.232719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 544/1084] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:15.238086 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06542fa1-3dc1-4eb5-a924-04cfcf9a098b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:15.238556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06542fa1-3dc1-4eb5-a924-04cfcf9a098b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:15.238637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06542fa1-3dc1-4eb5-a924-04cfcf9a098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:15.311233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-06542fa1-3dc1-4eb5-a924-04cfcf9a098b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:15.312371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-06542fa1-3dc1-4eb5-a924-04cfcf9a098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:15.422251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 541/1085] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:15.714388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b1c50-3fb0-41e5-a7e4-0fa95ab5eae1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:15.716011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-eb3b1c50-3fb0-41e5-a7e4-0fa95ab5eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:15.819359 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:15.881219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b1c50-3fb0-41e5-a7e4-0fa95ab5eae1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:16.080023 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bed540-cfc7-416d-909f-43aa133b82f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:16.080710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bed540-cfc7-416d-909f-43aa133b82f9 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:16.080997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bed540-cfc7-416d-909f-43aa133b82f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:16.081267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bed540-cfc7-416d-909f-43aa133b82f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:16.082868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a1bed540-cfc7-416d-909f-43aa133b82f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:16.153913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:16.192449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bed540-cfc7-416d-909f-43aa133b82f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:16.194054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bed540-cfc7-416d-909f-43aa133b82f9 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:16.214832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 545/1086] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:25.420858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=67 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:26.212262 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=20 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:29.806924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e02af6-ba38-4830-8923-553f765899ba None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:29.807516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e02af6-ba38-4830-8923-553f765899ba None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:29.807516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e02af6-ba38-4830-8923-553f765899ba None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:29.808829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 542/1087] 10.222.0.20 () {54 vars in 918 bytes} [Wed Nov 2 03:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:29.814171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a56e-3950-48a0-bc84-bff88fda70c9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:29.814619 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a56e-3950-48a0-bc84-bff88fda70c9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:29.814742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a56e-3950-48a0-bc84-bff88fda70c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:29.907020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-43f5a56e-3950-48a0-bc84-bff88fda70c9 None None] MFA Rules not processed for user `91b2777a51af45f5a86627d840f5b814`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:29.908223 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-43f5a56e-3950-48a0-bc84-bff88fda70c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:30.013225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 546/1088] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Nov 2 03:27:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:30.028488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80965ea8-0e78-46fd-a257-3d525155f4b3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:30.028796 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80965ea8-0e78-46fd-a257-3d525155f4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:30.029072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80965ea8-0e78-46fd-a257-3d525155f4b3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:30.030378 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 543/1089] 10.222.0.20 () {54 vars in 918 bytes} [Wed Nov 2 03:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:30.034883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e92539-fc03-40e6-880f-9a26985f9e27 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:30.035168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e92539-fc03-40e6-880f-9a26985f9e27 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:30.035441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e92539-fc03-40e6-880f-9a26985f9e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:30.109468 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:30.112106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b8e92539-fc03-40e6-880f-9a26985f9e27 None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:30.113952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b8e92539-fc03-40e6-880f-9a26985f9e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:30.227318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 547/1090] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Nov 2 03:27:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:32.813796 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b3867-6fe3-484b-91a2-67bbb7a2a0ed None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:32.814404 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b3867-6fe3-484b-91a2-67bbb7a2a0ed None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:32.814404 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b3867-6fe3-484b-91a2-67bbb7a2a0ed None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:32.815664 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 544/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:32.821485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3589-97d4-4f82-ad45-b9c74e754939 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:32.821919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3589-97d4-4f82-ad45-b9c74e754939 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:32.822021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be3589-97d4-4f82-ad45-b9c74e754939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:32.888122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-57be3589-97d4-4f82-ad45-b9c74e754939 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:32.889339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-57be3589-97d4-4f82-ad45-b9c74e754939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:32.944292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:32.988659 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 548/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:33.282169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b3867-6fe3-484b-91a2-67bbb7a2a0ed None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:33.283691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-999b3867-6fe3-484b-91a2-67bbb7a2a0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:33.429173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b3867-6fe3-484b-91a2-67bbb7a2a0ed None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:33.501431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:33.544167 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaec3c1-250e-4f75-b6b5-2bb3c429a53b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:33.544725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaec3c1-250e-4f75-b6b5-2bb3c429a53b service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:33.545010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaec3c1-250e-4f75-b6b5-2bb3c429a53b service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:33.545282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaec3c1-250e-4f75-b6b5-2bb3c429a53b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:33.546887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4aaec3c1-250e-4f75-b6b5-2bb3c429a53b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:33.638761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaec3c1-250e-4f75-b6b5-2bb3c429a53b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:33.640345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaec3c1-250e-4f75-b6b5-2bb3c429a53b service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:33.658694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 545/1093] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:34.792248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fd8e-888a-4652-a66c-519da5a55b0f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:34.792844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fd8e-888a-4652-a66c-519da5a55b0f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:34.792844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fd8e-888a-4652-a66c-519da5a55b0f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:34.794167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 549/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:34.799071 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094470-f3e3-4fe7-8412-3b2445ab7055 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:34.799537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094470-f3e3-4fe7-8412-3b2445ab7055 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:34.799645 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca094470-f3e3-4fe7-8412-3b2445ab7055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:34.875498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ca094470-f3e3-4fe7-8412-3b2445ab7055 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:34.876733 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ca094470-f3e3-4fe7-8412-3b2445ab7055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:34.904323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:34.972511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 546/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:27:35.134398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fd8e-888a-4652-a66c-519da5a55b0f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:35.136124 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-abf0fd8e-888a-4652-a66c-519da5a55b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:35.278412 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fd8e-888a-4652-a66c-519da5a55b0f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:35.321114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:35.393802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd7e6e-860f-40c4-890b-e5eeb158c5e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:35.394422 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd7e6e-860f-40c4-890b-e5eeb158c5e1 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:35.394708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd7e6e-860f-40c4-890b-e5eeb158c5e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:35.394978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd7e6e-860f-40c4-890b-e5eeb158c5e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:35.396595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5bcd7e6e-860f-40c4-890b-e5eeb158c5e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:35.484987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd7e6e-860f-40c4-890b-e5eeb158c5e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:35.486559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd7e6e-860f-40c4-890b-e5eeb158c5e1 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:35.504142 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 550/1096] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:36.641577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f9069-582f-4ef8-93ff-d0ed5721b690 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:36.642112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f9069-582f-4ef8-93ff-d0ed5721b690 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:36.642112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f9069-582f-4ef8-93ff-d0ed5721b690 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:36.643374 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 547/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:36.648990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3766d38-8170-4e63-9c0e-c11cb798230b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:36.649447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3766d38-8170-4e63-9c0e-c11cb798230b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:36.649550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3766d38-8170-4e63-9c0e-c11cb798230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:36.703548 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:36.727941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a3766d38-8170-4e63-9c0e-c11cb798230b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:36.729191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a3766d38-8170-4e63-9c0e-c11cb798230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:36.832152 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 551/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:36.985603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f9069-582f-4ef8-93ff-d0ed5721b690 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:36.987106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d07f9069-582f-4ef8-93ff-d0ed5721b690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:37.132839 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f9069-582f-4ef8-93ff-d0ed5721b690 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:37.144857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:37.246696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906f12f-5427-47b6-ad91-b81cccdb13e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:37.247247 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f12f-5427-47b6-ad91-b81cccdb13e5 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:37.247529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f12f-5427-47b6-ad91-b81cccdb13e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:37.247847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f12f-5427-47b6-ad91-b81cccdb13e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:37.249490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0906f12f-5427-47b6-ad91-b81cccdb13e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:37.340339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906f12f-5427-47b6-ad91-b81cccdb13e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:37.342149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906f12f-5427-47b6-ad91-b81cccdb13e5 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:37.360530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 548/1099] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:38.454919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1f8a-1091-4328-b542-fe323cc9f567 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:38.455473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1f8a-1091-4328-b542-fe323cc9f567 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:38.455473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1f8a-1091-4328-b542-fe323cc9f567 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:38.456817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 552/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:27:38.462297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18a8b5-82fd-412f-b326-e8abe4539052 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:38.462739 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18a8b5-82fd-412f-b326-e8abe4539052 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:38.462844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18a8b5-82fd-412f-b326-e8abe4539052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:38.482856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:38.541114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cd18a8b5-82fd-412f-b326-e8abe4539052 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:38.542311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cd18a8b5-82fd-412f-b326-e8abe4539052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:38.636112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 549/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:38.792886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1f8a-1091-4328-b542-fe323cc9f567 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:38.794395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c7bf1f8a-1091-4328-b542-fe323cc9f567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:38.902779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:38.938099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1f8a-1091-4328-b542-fe323cc9f567 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:39.049982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a462f27-f993-4749-a917-c16e9705052b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:39.050774 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462f27-f993-4749-a917-c16e9705052b service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:39.050914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462f27-f993-4749-a917-c16e9705052b service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:39.051125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462f27-f993-4749-a917-c16e9705052b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:39.052753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0a462f27-f993-4749-a917-c16e9705052b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:39.128758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:39.142445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a462f27-f993-4749-a917-c16e9705052b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:39.144043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a462f27-f993-4749-a917-c16e9705052b service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:39.161777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 553/1102] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:40.264243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37a3d3-96f6-4e94-b805-fbeba66b6af3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:40.264833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37a3d3-96f6-4e94-b805-fbeba66b6af3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:40.264833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37a3d3-96f6-4e94-b805-fbeba66b6af3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:40.266204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 550/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:40.271163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773b692-b1f0-42d0-9028-83d3d98ae135 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:40.271584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773b692-b1f0-42d0-9028-83d3d98ae135 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:40.271746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773b692-b1f0-42d0-9028-83d3d98ae135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:40.347521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b773b692-b1f0-42d0-9028-83d3d98ae135 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:40.348653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b773b692-b1f0-42d0-9028-83d3d98ae135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:40.445535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 554/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:40.595207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37a3d3-96f6-4e94-b805-fbeba66b6af3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:40.596778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ae37a3d3-96f6-4e94-b805-fbeba66b6af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:40.682816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:40.751490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37a3d3-96f6-4e94-b805-fbeba66b6af3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:40.869437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b95a9-3c4f-4482-92db-d2f320e7623d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:40.870041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b95a9-3c4f-4482-92db-d2f320e7623d service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:40.870323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b95a9-3c4f-4482-92db-d2f320e7623d service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:40.870595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b95a9-3c4f-4482-92db-d2f320e7623d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:40.872233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-555b95a9-3c4f-4482-92db-d2f320e7623d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:40.921530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:40.963576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b95a9-3c4f-4482-92db-d2f320e7623d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:40.965207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b95a9-3c4f-4482-92db-d2f320e7623d service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:40.983622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 551/1105] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:42.040604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdffc98-5ad1-40b4-83b8-0d842dde67dd None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:42.041165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdffc98-5ad1-40b4-83b8-0d842dde67dd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:42.041165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdffc98-5ad1-40b4-83b8-0d842dde67dd None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:42.042534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 555/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:42.047644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e0b94-2708-4804-9c2d-37eff1877449 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:42.048036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e0b94-2708-4804-9c2d-37eff1877449 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:42.049239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e0b94-2708-4804-9c2d-37eff1877449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:42.126502 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7b1e0b94-2708-4804-9c2d-37eff1877449 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:42.127733 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7b1e0b94-2708-4804-9c2d-37eff1877449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:42.223742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 552/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:27:42.375757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdffc98-5ad1-40b4-83b8-0d842dde67dd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:42.377311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0fdffc98-5ad1-40b4-83b8-0d842dde67dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:42.427494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:42.525419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdffc98-5ad1-40b4-83b8-0d842dde67dd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:42.641283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f20d6d-6354-43ad-8296-951021f7147b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:42.641887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f20d6d-6354-43ad-8296-951021f7147b service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:42.642165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f20d6d-6354-43ad-8296-951021f7147b service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:42.642452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f20d6d-6354-43ad-8296-951021f7147b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:42.644055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-79f20d6d-6354-43ad-8296-951021f7147b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:42.651380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:42.734258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f20d6d-6354-43ad-8296-951021f7147b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:42.735842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f20d6d-6354-43ad-8296-951021f7147b service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:42.755239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 556/1108] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:43.791093 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e1f45-50bd-4611-825c-4f80e8576e70 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:43.791642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e1f45-50bd-4611-825c-4f80e8576e70 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:43.791642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e1f45-50bd-4611-825c-4f80e8576e70 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:43.793015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 553/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:43.797824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db181c-a5f1-45b0-9057-225b6eecd3a9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:43.798250 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db181c-a5f1-45b0-9057-225b6eecd3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:43.798403 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db181c-a5f1-45b0-9057-225b6eecd3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:43.875483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-71db181c-a5f1-45b0-9057-225b6eecd3a9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:43.876714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-71db181c-a5f1-45b0-9057-225b6eecd3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:43.942844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:43.971471 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 557/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:27:44.124710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e1f45-50bd-4611-825c-4f80e8576e70 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:44.126251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4b8e1f45-50bd-4611-825c-4f80e8576e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:44.143842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:44.270278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e1f45-50bd-4611-825c-4f80e8576e70 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:44.358027 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:44.384590 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969a2d5-b64a-43ed-8e69-293f475f6364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:44.385200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a2d5-b64a-43ed-8e69-293f475f6364 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:44.385479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a2d5-b64a-43ed-8e69-293f475f6364 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:44.385751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a2d5-b64a-43ed-8e69-293f475f6364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:44.387351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8969a2d5-b64a-43ed-8e69-293f475f6364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:44.475740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969a2d5-b64a-43ed-8e69-293f475f6364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:44.477351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969a2d5-b64a-43ed-8e69-293f475f6364 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:44.495760 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 554/1111] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:45.546128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacd904-fd20-4d46-aff6-8374929328ec None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:45.546648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacd904-fd20-4d46-aff6-8374929328ec None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:45.546752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacd904-fd20-4d46-aff6-8374929328ec None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:45.548069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 558/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:27:45.553143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3365f-c5dd-4e0c-84ee-5d774073492e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:45.553617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3365f-c5dd-4e0c-84ee-5d774073492e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:45.553751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3365f-c5dd-4e0c-84ee-5d774073492e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:45.628687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8bb3365f-c5dd-4e0c-84ee-5d774073492e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:45.629896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8bb3365f-c5dd-4e0c-84ee-5d774073492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:45.671076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:45.725985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 555/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:45.876234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacd904-fd20-4d46-aff6-8374929328ec None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:45.877703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bcacd904-fd20-4d46-aff6-8374929328ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:46.023161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacd904-fd20-4d46-aff6-8374929328ec None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:46.078722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:46.137735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a76bb-f3e4-4860-bdbe-601ff02c2770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:46.138275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a76bb-f3e4-4860-bdbe-601ff02c2770 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:46.138560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a76bb-f3e4-4860-bdbe-601ff02c2770 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:46.138834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a76bb-f3e4-4860-bdbe-601ff02c2770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:46.140434 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-884a76bb-f3e4-4860-bdbe-601ff02c2770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:46.229046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a76bb-f3e4-4860-bdbe-601ff02c2770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:46.230631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a76bb-f3e4-4860-bdbe-601ff02c2770 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:46.249106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 559/1114] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:47.300837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc57a52-2b79-4b2d-bf18-3e3451c72e84 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:47.301354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc57a52-2b79-4b2d-bf18-3e3451c72e84 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:47.301354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc57a52-2b79-4b2d-bf18-3e3451c72e84 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:47.302663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 556/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:47.308193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7f531-8776-443b-acc8-78b68d716e4b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:47.308616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7f531-8776-443b-acc8-78b68d716e4b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:47.308770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7f531-8776-443b-acc8-78b68d716e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:47.385001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-52b7f531-8776-443b-acc8-78b68d716e4b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:47.386183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-52b7f531-8776-443b-acc8-78b68d716e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:47.388168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:47.481730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 560/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:47.630750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc57a52-2b79-4b2d-bf18-3e3451c72e84 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:47.632451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8fc57a52-2b79-4b2d-bf18-3e3451c72e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:47.777922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc57a52-2b79-4b2d-bf18-3e3451c72e84 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:47.806052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:47.895264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159575be-7c23-463e-90fc-3f9331e3991a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:47.895809 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159575be-7c23-463e-90fc-3f9331e3991a service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:47.896085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159575be-7c23-463e-90fc-3f9331e3991a service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:47.896355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159575be-7c23-463e-90fc-3f9331e3991a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:47.898573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-159575be-7c23-463e-90fc-3f9331e3991a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:47.991468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159575be-7c23-463e-90fc-3f9331e3991a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:47.993065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159575be-7c23-463e-90fc-3f9331e3991a service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:48.010759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 557/1117] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:50.154046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f6cf-215e-4b97-a39d-522100aea30e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:50.154614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f6cf-215e-4b97-a39d-522100aea30e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:50.154614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f6cf-215e-4b97-a39d-522100aea30e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:50.155979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 561/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:50.161447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51383e-36da-444a-9512-d5a1ccf1f926 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:50.161856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51383e-36da-444a-9512-d5a1ccf1f926 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:50.161989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51383e-36da-444a-9512-d5a1ccf1f926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:50.202865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:50.231198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5d51383e-36da-444a-9512-d5a1ccf1f926 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:50.232710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5d51383e-36da-444a-9512-d5a1ccf1f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:50.329135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 558/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:50.621674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9f6cf-215e-4b97-a39d-522100aea30e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:50.623250 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2af9f6cf-215e-4b97-a39d-522100aea30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:50.726377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9f6cf-215e-4b97-a39d-522100aea30e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:50.761224 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:50.802949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675deee4-5321-4cd3-83f2-f071c8394f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:50.804141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675deee4-5321-4cd3-83f2-f071c8394f76 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:50.804436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675deee4-5321-4cd3-83f2-f071c8394f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:50.804739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675deee4-5321-4cd3-83f2-f071c8394f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:50.806337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-675deee4-5321-4cd3-83f2-f071c8394f76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:50.914165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675deee4-5321-4cd3-83f2-f071c8394f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:50.915506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675deee4-5321-4cd3-83f2-f071c8394f76 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:50.933567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 562/1120] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:53.437469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de38f-ca36-47f2-b380-9684b4b0853e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:53.438038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de38f-ca36-47f2-b380-9684b4b0853e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:53.438038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1de38f-ca36-47f2-b380-9684b4b0853e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:53.439252 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 559/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:53.445000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606d81-8687-4e2b-9ffc-9ae29921e3e8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:53.445419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606d81-8687-4e2b-9ffc-9ae29921e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:53.445548 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606d81-8687-4e2b-9ffc-9ae29921e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:53.511644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bd606d81-8687-4e2b-9ffc-9ae29921e3e8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:53.512880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bd606d81-8687-4e2b-9ffc-9ae29921e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:53.526053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:53.609235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 563/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:53.894380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1de38f-ca36-47f2-b380-9684b4b0853e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:53.895930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fe1de38f-ca36-47f2-b380-9684b4b0853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:54.002618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1de38f-ca36-47f2-b380-9684b4b0853e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:54.015250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:54.079191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264bbef-f851-447e-ba0e-b9f9cc6bfc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:54.079797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264bbef-f851-447e-ba0e-b9f9cc6bfc9f service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:54.080077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264bbef-f851-447e-ba0e-b9f9cc6bfc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:54.080349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264bbef-f851-447e-ba0e-b9f9cc6bfc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:54.081983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d264bbef-f851-447e-ba0e-b9f9cc6bfc9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:54.190953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264bbef-f851-447e-ba0e-b9f9cc6bfc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:54.192291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264bbef-f851-447e-ba0e-b9f9cc6bfc9f service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:54.210890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 560/1123] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:56.695072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3421e9-aeb3-4af4-b6cf-b1cb88f7eabb None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:56.695600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3421e9-aeb3-4af4-b6cf-b1cb88f7eabb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:56.695600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3421e9-aeb3-4af4-b6cf-b1cb88f7eabb None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:56.696932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 564/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:56.702264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd094d-72a9-49ec-a2fc-d3a4e923cb59 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:56.702693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd094d-72a9-49ec-a2fc-d3a4e923cb59 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:56.702796 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd094d-72a9-49ec-a2fc-d3a4e923cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:56.751270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:56.769449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-39cd094d-72a9-49ec-a2fc-d3a4e923cb59 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:56.770646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-39cd094d-72a9-49ec-a2fc-d3a4e923cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:56.864718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 561/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:27:57.150950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3421e9-aeb3-4af4-b6cf-b1cb88f7eabb None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:27:57.152559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0d3421e9-aeb3-4af4-b6cf-b1cb88f7eabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:57.254373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3421e9-aeb3-4af4-b6cf-b1cb88f7eabb None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:27:57.293939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:57.328659 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17b81f-205a-4d55-9897-ae457e3b3f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:27:57.329192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b81f-205a-4d55-9897-ae457e3b3f0f service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:57.329494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b81f-205a-4d55-9897-ae457e3b3f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:57.329764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b81f-205a-4d55-9897-ae457e3b3f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:57.331352 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9a17b81f-205a-4d55-9897-ae457e3b3f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:57.439045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17b81f-205a-4d55-9897-ae457e3b3f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:27:57.440495 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17b81f-205a-4d55-9897-ae457e3b3f0f service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:27:57.458326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 565/1126] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:27:59.731729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbc659-df17-40c6-a44a-2024882d3bae None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:59.732326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbc659-df17-40c6-a44a-2024882d3bae None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:59.732326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbc659-df17-40c6-a44a-2024882d3bae None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:59.733906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 562/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:27:59.739308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd9451-d3f8-463e-a55e-e7a1f3a39e1a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:27:59.739767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd9451-d3f8-463e-a55e-e7a1f3a39e1a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:27:59.739861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd9451-d3f8-463e-a55e-e7a1f3a39e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:27:59.808150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cffd9451-d3f8-463e-a55e-e7a1f3a39e1a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:27:59.809373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cffd9451-d3f8-463e-a55e-e7a1f3a39e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:27:59.829741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:27:59.905469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 566/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:00.190000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbc659-df17-40c6-a44a-2024882d3bae None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:00.191545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8adbc659-df17-40c6-a44a-2024882d3bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:00.293983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbc659-df17-40c6-a44a-2024882d3bae None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:00.314134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:00.368148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8dddb-446a-4a60-9e34-34dff4fdff60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:00.368830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8dddb-446a-4a60-9e34-34dff4fdff60 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:00.369220 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8dddb-446a-4a60-9e34-34dff4fdff60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:00.369499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8dddb-446a-4a60-9e34-34dff4fdff60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:00.371100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-45d8dddb-446a-4a60-9e34-34dff4fdff60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:00.479603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8dddb-446a-4a60-9e34-34dff4fdff60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:00.481085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8dddb-446a-4a60-9e34-34dff4fdff60 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:00.499397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 563/1129] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:02.688153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81182-1491-4785-a3b1-41c0e596906f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:02.688722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81182-1491-4785-a3b1-41c0e596906f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:02.688722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81182-1491-4785-a3b1-41c0e596906f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:02.690010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 567/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:02.695671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b65f9-6846-4eb1-a93c-d6a7baa05cd9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:02.696085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b65f9-6846-4eb1-a93c-d6a7baa05cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:02.696220 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b65f9-6846-4eb1-a93c-d6a7baa05cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:02.761683 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:02.764637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6e3b65f9-6846-4eb1-a93c-d6a7baa05cd9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:02.766203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6e3b65f9-6846-4eb1-a93c-d6a7baa05cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:02.861162 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 564/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:03.142873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f81182-1491-4785-a3b1-41c0e596906f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:03.144726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-67f81182-1491-4785-a3b1-41c0e596906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:03.247151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f81182-1491-4785-a3b1-41c0e596906f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:03.296479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:03.321055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243ab59-ee35-4e26-9aee-6f092756edc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:03.321659 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243ab59-ee35-4e26-9aee-6f092756edc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:03.321939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243ab59-ee35-4e26-9aee-6f092756edc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:03.322211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243ab59-ee35-4e26-9aee-6f092756edc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:03.323801 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2243ab59-ee35-4e26-9aee-6f092756edc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:03.431254 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243ab59-ee35-4e26-9aee-6f092756edc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:03.432709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243ab59-ee35-4e26-9aee-6f092756edc8 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:03.450260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 568/1132] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:05.654779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4180efe-73a5-43bc-bc15-d58a481b3a78 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:05.655371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4180efe-73a5-43bc-bc15-d58a481b3a78 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:05.655481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4180efe-73a5-43bc-bc15-d58a481b3a78 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:05.656786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 565/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:05.661962 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0b28e-417f-4300-8603-930f81a04f8d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:05.662401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0b28e-417f-4300-8603-930f81a04f8d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:05.662510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0b28e-417f-4300-8603-930f81a04f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:05.727773 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-59b0b28e-417f-4300-8603-930f81a04f8d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:05.728995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-59b0b28e-417f-4300-8603-930f81a04f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:05.759767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:05.826892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 569/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:06.119355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4180efe-73a5-43bc-bc15-d58a481b3a78 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:06.120940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e4180efe-73a5-43bc-bc15-d58a481b3a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:06.224171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4180efe-73a5-43bc-bc15-d58a481b3a78 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:06.253500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:06.298168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f2c8-b1d7-4fcc-959c-e0c7eb75204a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:06.298775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f2c8-b1d7-4fcc-959c-e0c7eb75204a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:06.299059 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f2c8-b1d7-4fcc-959c-e0c7eb75204a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:06.299337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f2c8-b1d7-4fcc-959c-e0c7eb75204a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:06.300951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a2b7f2c8-b1d7-4fcc-959c-e0c7eb75204a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:06.409407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7f2c8-b1d7-4fcc-959c-e0c7eb75204a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:06.410829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7f2c8-b1d7-4fcc-959c-e0c7eb75204a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:06.430091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 566/1135] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:08.623273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9775-2f1a-4124-8549-0d04db8d219f None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:08.623848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9775-2f1a-4124-8549-0d04db8d219f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:08.623848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9775-2f1a-4124-8549-0d04db8d219f None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:08.625216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 570/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:08.630451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e9f25-9f10-4b90-9910-fdd563e25b0d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:08.630880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e9f25-9f10-4b90-9910-fdd563e25b0d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:08.630985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e9f25-9f10-4b90-9910-fdd563e25b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:08.696028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c01e9f25-9f10-4b90-9910-fdd563e25b0d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:08.697203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c01e9f25-9f10-4b90-9910-fdd563e25b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:08.705341 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:08.795415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 567/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:09.086380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f9775-2f1a-4124-8549-0d04db8d219f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:09.087921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bf2f9775-2f1a-4124-8549-0d04db8d219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:09.192932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f9775-2f1a-4124-8549-0d04db8d219f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:09.249415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:09.268585 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a390f0-6442-4d61-b1ad-c28384df34a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:09.269218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a390f0-6442-4d61-b1ad-c28384df34a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:09.269505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a390f0-6442-4d61-b1ad-c28384df34a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:09.269782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a390f0-6442-4d61-b1ad-c28384df34a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:09.271414 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-35a390f0-6442-4d61-b1ad-c28384df34a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:09.380227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a390f0-6442-4d61-b1ad-c28384df34a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:09.382550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a390f0-6442-4d61-b1ad-c28384df34a8 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:09.400855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 571/1138] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:11.700260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4134-b1b3-462e-b291-af4c1bfac610 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:11.700832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4134-b1b3-462e-b291-af4c1bfac610 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:11.700832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4134-b1b3-462e-b291-af4c1bfac610 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:11.702090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:11.707499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e2da-e4db-470d-a35a-965f9aed1df6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:11.707917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e2da-e4db-470d-a35a-965f9aed1df6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:11.708050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e2da-e4db-470d-a35a-965f9aed1df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:11.776034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3200e2da-e4db-470d-a35a-965f9aed1df6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:11.777267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3200e2da-e4db-470d-a35a-965f9aed1df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:11.815956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:11.876167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:12.160254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c4134-b1b3-462e-b291-af4c1bfac610 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:12.161814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-941c4134-b1b3-462e-b291-af4c1bfac610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:12.265231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c4134-b1b3-462e-b291-af4c1bfac610 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:12.302370 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:12.340697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbf0e3-76a6-4a45-a7ec-465cc822cfe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:12.341304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbf0e3-76a6-4a45-a7ec-465cc822cfe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:12.341607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbf0e3-76a6-4a45-a7ec-465cc822cfe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:12.341876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbf0e3-76a6-4a45-a7ec-465cc822cfe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:12.343852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9adbf0e3-76a6-4a45-a7ec-465cc822cfe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:12.453304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbf0e3-76a6-4a45-a7ec-465cc822cfe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:12.454721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbf0e3-76a6-4a45-a7ec-465cc822cfe5 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:12.472465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 569/1141] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:14.661557 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685203-6328-4f0c-bd9f-eb465875c75a None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:14.662101 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685203-6328-4f0c-bd9f-eb465875c75a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:14.662101 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685203-6328-4f0c-bd9f-eb465875c75a None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:14.664337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:14.669647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f421c1c-bcf8-42e0-ae83-ca0e7e979593 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:14.670067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f421c1c-bcf8-42e0-ae83-ca0e7e979593 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:14.670202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f421c1c-bcf8-42e0-ae83-ca0e7e979593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:14.738635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4f421c1c-bcf8-42e0-ae83-ca0e7e979593 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:14.739847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4f421c1c-bcf8-42e0-ae83-ca0e7e979593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:14.761277 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:14.841118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:15.125826 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16685203-6328-4f0c-bd9f-eb465875c75a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:15.127405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-16685203-6328-4f0c-bd9f-eb465875c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:15.230424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16685203-6328-4f0c-bd9f-eb465875c75a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:15.296007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:15.302893 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e28dd7-8a79-4262-bcef-5ab11edbf2af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:15.304174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e28dd7-8a79-4262-bcef-5ab11edbf2af service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:15.304565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e28dd7-8a79-4262-bcef-5ab11edbf2af service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:15.304842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e28dd7-8a79-4262-bcef-5ab11edbf2af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:15.306444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b1e28dd7-8a79-4262-bcef-5ab11edbf2af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:15.413660 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e28dd7-8a79-4262-bcef-5ab11edbf2af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:15.415085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e28dd7-8a79-4262-bcef-5ab11edbf2af service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:15.433686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 574/1144] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:17.592129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95103f1a-54db-4a18-af4d-38a9d9aa7d7b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:17.592737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95103f1a-54db-4a18-af4d-38a9d9aa7d7b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:17.592737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95103f1a-54db-4a18-af4d-38a9d9aa7d7b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:17.594038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:17.599207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9ae98-2eec-4436-b4d3-08266afb9dcd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:17.599606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9ae98-2eec-4436-b4d3-08266afb9dcd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:17.599758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9ae98-2eec-4436-b4d3-08266afb9dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:17.665761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5bb9ae98-2eec-4436-b4d3-08266afb9dcd None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:17.666960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5bb9ae98-2eec-4436-b4d3-08266afb9dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:17.714477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:17.762796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:18.047531 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95103f1a-54db-4a18-af4d-38a9d9aa7d7b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:18.049093 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-95103f1a-54db-4a18-af4d-38a9d9aa7d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:18.153072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95103f1a-54db-4a18-af4d-38a9d9aa7d7b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:18.201407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:18.227483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000291b-fcab-416c-b97f-90f334f7d4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:18.228088 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000291b-fcab-416c-b97f-90f334f7d4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:18.228364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000291b-fcab-416c-b97f-90f334f7d4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:18.228665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000291b-fcab-416c-b97f-90f334f7d4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:18.230253 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2000291b-fcab-416c-b97f-90f334f7d4e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:18.337367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000291b-fcab-416c-b97f-90f334f7d4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:18.338703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000291b-fcab-416c-b97f-90f334f7d4e1 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:18.356617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 572/1147] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:27.761270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=22 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:28.354456 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=66 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:38.347272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922420-1afe-45af-8ef5-39a87dd0d0ac None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:38.347798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922420-1afe-45af-8ef5-39a87dd0d0ac None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:38.347798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922420-1afe-45af-8ef5-39a87dd0d0ac None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:38.349117 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 576/1148] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:38.355050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6b12-4d9a-4d0d-b450-f86badc100dc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:38.355485 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6b12-4d9a-4d0d-b450-f86badc100dc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:38.355626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6b12-4d9a-4d0d-b450-f86badc100dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:38.423203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ef0c6b12-4d9a-4d0d-b450-f86badc100dc None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:38.424413 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef0c6b12-4d9a-4d0d-b450-f86badc100dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:38.519851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 573/1149] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:38.820454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dad8b3-ced3-4354-9c44-c75f0f00ac0e None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:38.820766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dad8b3-ced3-4354-9c44-c75f0f00ac0e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:38.821042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dad8b3-ced3-4354-9c44-c75f0f00ac0e None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:38.822360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 577/1150] 10.222.0.20 () {54 vars in 962 bytes} [Wed Nov 2 03:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:38.827593 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127b1d-9673-489f-a913-983119ac2100 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:38.827883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127b1d-9673-489f-a913-983119ac2100 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:38.828185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127b1d-9673-489f-a913-983119ac2100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:38.904127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4e127b1d-9673-489f-a913-983119ac2100 None None] MFA Rules not processed for user `4b71b778b0b24cbb92446070934d68ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:38.905277 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4e127b1d-9673-489f-a913-983119ac2100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:38.925874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:38.980876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 574/1151] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Nov 2 03:28:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:28:38.988922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dad8b3-ced3-4354-9c44-c75f0f00ac0e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:38.990465 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-06dad8b3-ced3-4354-9c44-c75f0f00ac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:39.094764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dad8b3-ced3-4354-9c44-c75f0f00ac0e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:39.169612 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9828-5d7f-4e94-87dc-f424ffb499ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b71b778b0b24cbb92446070934d68ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:39.170150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9828-5d7f-4e94-87dc-f424ffb499ed service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:39.170431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9828-5d7f-4e94-87dc-f424ffb499ed service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:39.170706 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9828-5d7f-4e94-87dc-f424ffb499ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:39.172308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-af0a9828-5d7f-4e94-87dc-f424ffb499ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:39.226251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:39.280656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9828-5d7f-4e94-87dc-f424ffb499ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:39.282074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9828-5d7f-4e94-87dc-f424ffb499ed service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:39.300183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 578/1152] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:41.545720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332907e-73d0-41e3-9770-848023e7fa62 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:41.546295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332907e-73d0-41e3-9770-848023e7fa62 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:41.546295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332907e-73d0-41e3-9770-848023e7fa62 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:41.547604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 575/1153] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:41.552997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da394e19-c9da-4ce0-86c1-81fb98f552ed None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:41.553404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da394e19-c9da-4ce0-86c1-81fb98f552ed None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:41.553514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da394e19-c9da-4ce0-86c1-81fb98f552ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:41.619009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-da394e19-c9da-4ce0-86c1-81fb98f552ed None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:41.620193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-da394e19-c9da-4ce0-86c1-81fb98f552ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:41.715356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 579/1154] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:41.992745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332907e-73d0-41e3-9770-848023e7fa62 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:41.994284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f332907e-73d0-41e3-9770-848023e7fa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:42.119520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332907e-73d0-41e3-9770-848023e7fa62 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:42.169406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:42.214508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d28662-32bd-4d29-9a23-3471d9227289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:42.215112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d28662-32bd-4d29-9a23-3471d9227289 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:42.215387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d28662-32bd-4d29-9a23-3471d9227289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:42.215654 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d28662-32bd-4d29-9a23-3471d9227289 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:42.216279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d28662-32bd-4d29-9a23-3471d9227289 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:42.217389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-a7d28662-32bd-4d29-9a23-3471d9227289 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:28:42.217389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Nov 02 03:28:42.217389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: Nov 02 03:28:42.218506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d28662-32bd-4d29-9a23-3471d9227289 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:42.237721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 576/1155] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Nov 2 03:28:41 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:28:44.444680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd7ffa-8c63-492c-902a-a6afd2ebeb16 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:44.445157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd7ffa-8c63-492c-902a-a6afd2ebeb16 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:44.445311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd7ffa-8c63-492c-902a-a6afd2ebeb16 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:44.446730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 580/1156] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:44.452082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0d5e5-1ae0-4c3b-9acd-d41b573c9790 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:44.452547 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0d5e5-1ae0-4c3b-9acd-d41b573c9790 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:44.452665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0d5e5-1ae0-4c3b-9acd-d41b573c9790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:44.518875 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-34e0d5e5-1ae0-4c3b-9acd-d41b573c9790 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:44.520084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-34e0d5e5-1ae0-4c3b-9acd-d41b573c9790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:44.615916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 577/1157] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:44.911398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd7ffa-8c63-492c-902a-a6afd2ebeb16 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:44.913007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c0cd7ffa-8c63-492c-902a-a6afd2ebeb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:44.922920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:45.063170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd7ffa-8c63-492c-902a-a6afd2ebeb16 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:45.144786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:45.178549 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb36be-d95d-459d-b393-2df25f80a7c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:45.179088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb36be-d95d-459d-b393-2df25f80a7c2 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:45.179371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb36be-d95d-459d-b393-2df25f80a7c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:45.180580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb36be-d95d-459d-b393-2df25f80a7c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:45.182307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b2cb36be-d95d-459d-b393-2df25f80a7c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:45.269300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb36be-d95d-459d-b393-2df25f80a7c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:45.270874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb36be-d95d-459d-b393-2df25f80a7c2 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:45.288231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 581/1158] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:47.626227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b9203-609d-43eb-94f4-dee6536de965 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:47.626788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b9203-609d-43eb-94f4-dee6536de965 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:47.626788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b9203-609d-43eb-94f4-dee6536de965 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:47.628119 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 578/1159] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:47.634018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946480d-9b8d-4f48-8dad-596cd7079986 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:47.634465 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946480d-9b8d-4f48-8dad-596cd7079986 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:47.634581 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946480d-9b8d-4f48-8dad-596cd7079986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:47.700127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e946480d-9b8d-4f48-8dad-596cd7079986 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:47.701348 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e946480d-9b8d-4f48-8dad-596cd7079986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:47.748091 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:47.797979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 582/1160] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:48.082351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b9203-609d-43eb-94f4-dee6536de965 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:48.083958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a66b9203-609d-43eb-94f4-dee6536de965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:48.107942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:48.187559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b9203-609d-43eb-94f4-dee6536de965 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:48.261217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a3a13-4f8f-419d-a865-d02e8f4262a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:48.261818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a3a13-4f8f-419d-a865-d02e8f4262a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:48.262098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a3a13-4f8f-419d-a865-d02e8f4262a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:48.262370 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a3a13-4f8f-419d-a865-d02e8f4262a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:48.263949 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-806a3a13-4f8f-419d-a865-d02e8f4262a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:48.338879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:48.375833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a3a13-4f8f-419d-a865-d02e8f4262a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:48.377297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a3a13-4f8f-419d-a865-d02e8f4262a3 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:48.395906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 579/1161] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:50.582232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462102e6-cb44-45fe-aadb-5ea538173504 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:50.583106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462102e6-cb44-45fe-aadb-5ea538173504 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:50.583394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462102e6-cb44-45fe-aadb-5ea538173504 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:50.584858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 583/1162] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:50.590835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a6c4-3552-482b-be4d-b757045bf17a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:50.591236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a6c4-3552-482b-be4d-b757045bf17a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:50.591388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a6c4-3552-482b-be4d-b757045bf17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:50.657529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2753a6c4-3552-482b-be4d-b757045bf17a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:50.658744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2753a6c4-3552-482b-be4d-b757045bf17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:50.754923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 580/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:51.050442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462102e6-cb44-45fe-aadb-5ea538173504 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:51.052003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-462102e6-cb44-45fe-aadb-5ea538173504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:51.157145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462102e6-cb44-45fe-aadb-5ea538173504 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:51.228145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:51.229709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d399b1-279d-4ca5-b77e-bdbf9bebc58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:51.230346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d399b1-279d-4ca5-b77e-bdbf9bebc58d service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:51.230627 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d399b1-279d-4ca5-b77e-bdbf9bebc58d service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:51.230939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d399b1-279d-4ca5-b77e-bdbf9bebc58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:51.233134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d5d399b1-279d-4ca5-b77e-bdbf9bebc58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:51.343254 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d399b1-279d-4ca5-b77e-bdbf9bebc58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:51.344721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d399b1-279d-4ca5-b77e-bdbf9bebc58d service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:51.362630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 584/1164] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:53.608512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dea23c-a60e-49e4-97df-0cb81e9022e9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:53.609111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dea23c-a60e-49e4-97df-0cb81e9022e9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:53.609111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dea23c-a60e-49e4-97df-0cb81e9022e9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:53.610650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 581/1165] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:53.615897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0690-7faa-4c98-8534-cd349de457b8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:53.616299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0690-7faa-4c98-8534-cd349de457b8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:53.616543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0690-7faa-4c98-8534-cd349de457b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:53.682489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4bac0690-7faa-4c98-8534-cd349de457b8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:53.683682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4bac0690-7faa-4c98-8534-cd349de457b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:53.736577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:53.782620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 585/1166] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:54.075394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dea23c-a60e-49e4-97df-0cb81e9022e9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:54.076978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-93dea23c-a60e-49e4-97df-0cb81e9022e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:54.113215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:54.182097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dea23c-a60e-49e4-97df-0cb81e9022e9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:54.255653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d26075-0e48-4c12-a46b-d205f5090903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:54.256261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d26075-0e48-4c12-a46b-d205f5090903 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:54.256576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d26075-0e48-4c12-a46b-d205f5090903 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:54.256848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d26075-0e48-4c12-a46b-d205f5090903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:54.259050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-24d26075-0e48-4c12-a46b-d205f5090903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:54.340506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:54.371584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d26075-0e48-4c12-a46b-d205f5090903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:54.373062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d26075-0e48-4c12-a46b-d205f5090903 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:54.391854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 582/1167] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:28:56.795339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a048e-c02a-433f-9892-ee67241de9c5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:56.795935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a048e-c02a-433f-9892-ee67241de9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:56.795935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a048e-c02a-433f-9892-ee67241de9c5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:56.797298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 586/1168] 10.222.0.20 () {54 vars in 927 bytes} [Wed Nov 2 03:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:28:56.802612 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff2f1e-79d7-4c68-95a8-e1930d26db6a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:56.802999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff2f1e-79d7-4c68-95a8-e1930d26db6a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:56.803169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff2f1e-79d7-4c68-95a8-e1930d26db6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:56.869750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6dff2f1e-79d7-4c68-95a8-e1930d26db6a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:28:56.870948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6dff2f1e-79d7-4c68-95a8-e1930d26db6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:56.966626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 583/1169] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Nov 2 03:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:28:57.256986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a048e-c02a-433f-9892-ee67241de9c5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:28:57.259217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a11a048e-c02a-433f-9892-ee67241de9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:57.363590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a048e-c02a-433f-9892-ee67241de9c5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:28:57.438081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15536112-eb71-4a75-9fe9-6e12031958f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:28:57.438745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15536112-eb71-4a75-9fe9-6e12031958f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:28:57.439029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15536112-eb71-4a75-9fe9-6e12031958f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:28:57.439304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15536112-eb71-4a75-9fe9-6e12031958f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:28:57.440931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-15536112-eb71-4a75-9fe9-6e12031958f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:28:57.450380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:28:57.553301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15536112-eb71-4a75-9fe9-6e12031958f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:28:57.555339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15536112-eb71-4a75-9fe9-6e12031958f0 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:28:57.573732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 587/1170] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:29:06.965097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=82 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:29:07.571339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=50 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:10.458609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19fa10-c083-407d-a832-f5e80179c829 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:10.459177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19fa10-c083-407d-a832-f5e80179c829 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:10.459177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19fa10-c083-407d-a832-f5e80179c829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:10.535932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fc19fa10-c083-407d-a832-f5e80179c829 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:30:10.537148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fc19fa10-c083-407d-a832-f5e80179c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:10.631677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 584/1171] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:30:10.640071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0386-90a3-4e3d-a72a-206360c392e1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:10.640620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0386-90a3-4e3d-a72a-206360c392e1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:10.640724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0386-90a3-4e3d-a72a-206360c392e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:10.717797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c46d0386-90a3-4e3d-a72a-206360c392e1 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:30:10.718911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c46d0386-90a3-4e3d-a72a-206360c392e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:10.819032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 588/1172] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:30:10.824248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19fa10-c083-407d-a832-f5e80179c829 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:30:10.825474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fc19fa10-c083-407d-a832-f5e80179c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:10.837753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19fa10-c083-407d-a832-f5e80179c829 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:30:10.897300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:10.931712 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:30:10.932308 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:10.932611 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:10.932879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:10.933517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:30:10.933809 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:30:10.934805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:30:10.934805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Nov 02 03:30:10.934805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: Nov 02 03:30:10.935690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:30:10.947020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 585/1173] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:30:10.956555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d0386-90a3-4e3d-a72a-206360c392e1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:30:10.966297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d0386-90a3-4e3d-a72a-206360c392e1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:30:11.029656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:11.065039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0d2d-948e-49dd-8868-dbf36dd10e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:30:11.065646 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0d2d-948e-49dd-8868-dbf36dd10e92 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:11.065924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0d2d-948e-49dd-8868-dbf36dd10e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:11.066196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0d2d-948e-49dd-8868-dbf36dd10e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:11.066819 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a0d2d-948e-49dd-8868-dbf36dd10e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:30:11.067914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-df9a0d2d-948e-49dd-8868-dbf36dd10e92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:30:11.067914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: warnings.warn(msg) Nov 02 03:30:11.067914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: Nov 02 03:30:11.069131 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a0d2d-948e-49dd-8868-dbf36dd10e92 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:30:11.125126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 589/1174] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:30:10 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:30:11.129401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:30:11.130949 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:11.164403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe765e-2a2f-48a4-8955-16f3de05baf3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:30:11.256961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff112a5-b689-4050-b27a-25d56cd91a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:30:11.258082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff112a5-b689-4050-b27a-25d56cd91a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:11.258447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff112a5-b689-4050-b27a-25d56cd91a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:11.258723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff112a5-b689-4050-b27a-25d56cd91a9d admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:11.259426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff112a5-b689-4050-b27a-25d56cd91a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:30:11.260425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-fff112a5-b689-4050-b27a-25d56cd91a9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:30:11.260425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Nov 02 03:30:11.260425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: Nov 02 03:30:11.261659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff112a5-b689-4050-b27a-25d56cd91a9d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:30:11.302692 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 586/1175] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:30:11 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:30:11.307572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0d2d-948e-49dd-8868-dbf36dd10e92 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:30:11.309271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-df9a0d2d-948e-49dd-8868-dbf36dd10e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:11.376813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0d2d-948e-49dd-8868-dbf36dd10e92 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:30:11.458349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:11.469545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185f5e0-f7ff-4347-98b8-193e04857f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:30:11.470156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f5e0-f7ff-4347-98b8-193e04857f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:11.470435 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f5e0-f7ff-4347-98b8-193e04857f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:11.470705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f5e0-f7ff-4347-98b8-193e04857f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:11.471345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185f5e0-f7ff-4347-98b8-193e04857f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:30:11.473000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185f5e0-f7ff-4347-98b8-193e04857f8f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:30:11.485699 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 590/1176] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:30:11.490110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff112a5-b689-4050-b27a-25d56cd91a9d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:30:11.492259 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fff112a5-b689-4050-b27a-25d56cd91a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:11.503986 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff112a5-b689-4050-b27a-25d56cd91a9d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:30:11.528701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:11.597976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752de76f-e858-4ece-9c26-8c089f2e47e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:30:11.598573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de76f-e858-4ece-9c26-8c089f2e47e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:11.598853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de76f-e858-4ece-9c26-8c089f2e47e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:11.599123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de76f-e858-4ece-9c26-8c089f2e47e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:11.599759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752de76f-e858-4ece-9c26-8c089f2e47e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:30:11.602080 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752de76f-e858-4ece-9c26-8c089f2e47e8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:30:11.614475 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 587/1177] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:30:11.619214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185f5e0-f7ff-4347-98b8-193e04857f8f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:30:11.620780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d185f5e0-f7ff-4347-98b8-193e04857f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:11.653349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185f5e0-f7ff-4347-98b8-193e04857f8f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:30:11.746470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0a43a-909d-43bb-9e5f-ae565d132d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:30:11.747120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0a43a-909d-43bb-9e5f-ae565d132d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:11.747398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0a43a-909d-43bb-9e5f-ae565d132d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:11.747669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0a43a-909d-43bb-9e5f-ae565d132d56 admin admin] PATH_INFO: `/v3/projects/4b8fce5f847242f797336ff9db8809b6/users/24896c2ffdd74d5a9a2b685fa14ab8d8/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:11.770910 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0a43a-909d-43bb-9e5f-ae565d132d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8fce5f847242f797336ff9db8809b6, user_id=24896c2ffdd74d5a9a2b685fa14ab8d8, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:30:11.774332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0a43a-909d-43bb-9e5f-ae565d132d56 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:30:11.798641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 591/1178] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:30:11 2022] PUT /identity/v3/projects/4b8fce5f847242f797336ff9db8809b6/users/24896c2ffdd74d5a9a2b685fa14ab8d8/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:30:11.809956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0617c-d743-4855-b7ec-13198c82288f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:11.810242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0617c-d743-4855-b7ec-13198c82288f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:11.810513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0617c-d743-4855-b7ec-13198c82288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:11.867698 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-84d0617c-d743-4855-b7ec-13198c82288f None None] MFA Rules not processed for user `24896c2ffdd74d5a9a2b685fa14ab8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:30:11.868917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-84d0617c-d743-4855-b7ec-13198c82288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:11.944604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 588/1179] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:30:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:30:11.958170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608fdc-3fe6-4fe5-b601-a95aba4aa9bc None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:11.958454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608fdc-3fe6-4fe5-b601-a95aba4aa9bc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:11.958725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608fdc-3fe6-4fe5-b601-a95aba4aa9bc None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:11.960072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 592/1180] 10.222.0.20 () {54 vars in 963 bytes} [Wed Nov 2 03:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:30:11.965699 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b1e6-d672-4b49-b50b-68b2754170b7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:11.966014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b1e6-d672-4b49-b50b-68b2754170b7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:11.966293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b1e6-d672-4b49-b50b-68b2754170b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:11.998411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:12.044753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-87b9b1e6-d672-4b49-b50b-68b2754170b7 None None] MFA Rules not processed for user `de29056c157e47a49e55a75fb0792dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:30:12.045964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-87b9b1e6-d672-4b49-b50b-68b2754170b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:12.121933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 589/1181] 10.222.0.20 () {58 vars in 1060 bytes} [Wed Nov 2 03:30:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:30:12.131379 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608fdc-3fe6-4fe5-b601-a95aba4aa9bc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:30:12.133606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e9608fdc-3fe6-4fe5-b601-a95aba4aa9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:12.182534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:12.237741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608fdc-3fe6-4fe5-b601-a95aba4aa9bc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:30:12.310406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa15d-e0a2-45ad-bb61-73a9bb4bc783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:30:12.311004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa15d-e0a2-45ad-bb61-73a9bb4bc783 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:12.311278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa15d-e0a2-45ad-bb61-73a9bb4bc783 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:12.311544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aa15d-e0a2-45ad-bb61-73a9bb4bc783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:12.313163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ed9aa15d-e0a2-45ad-bb61-73a9bb4bc783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:12.413121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aa15d-e0a2-45ad-bb61-73a9bb4bc783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:30:12.414509 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aa15d-e0a2-45ad-bb61-73a9bb4bc783 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:30:12.417886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:12.432569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 593/1182] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:30:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:30:12.478254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7923d-69cd-4731-bd16-3d30f21956b8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:12.478544 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7923d-69cd-4731-bd16-3d30f21956b8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:12.478824 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7923d-69cd-4731-bd16-3d30f21956b8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:12.480067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 590/1183] 10.222.0.20 () {52 vars in 830 bytes} [Wed Nov 2 03:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:30:12.483635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa15d-e0a2-45ad-bb61-73a9bb4bc783 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:30:12.484875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ed9aa15d-e0a2-45ad-bb61-73a9bb4bc783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:12.582463 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aa15d-e0a2-45ad-bb61-73a9bb4bc783 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:30:12.678729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:30:12.680105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:12.680105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:12.680270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] PATH_INFO: `/v3/users/24896c2ffdd74d5a9a2b685fa14ab8d8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:12.692955 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=24896c2ffdd74d5a9a2b685fa14ab8d8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:30:12.694009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:30:12.694009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: warnings.warn(msg) Nov 02 03:30:12.694009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: Nov 02 03:30:12.695837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:30:12.705654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:12.765454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24896c2ffdd74d5a9a2b685fa14ab8d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:30:12.765903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24896c2ffdd74d5a9a2b685fa14ab8d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:30:12.780097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24896c2ffdd74d5a9a2b685fa14ab8d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:30:12.780700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24896c2ffdd74d5a9a2b685fa14ab8d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:30:12.803276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24896c2ffdd74d5a9a2b685fa14ab8d8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:30:12.818235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 594/1184] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:30:12 2022] DELETE /identity/v3/users/24896c2ffdd74d5a9a2b685fa14ab8d8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:30:12.823251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a94d0-b2b9-480a-9bc5-2ad2fda421d1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:12.823759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a94d0-b2b9-480a-9bc5-2ad2fda421d1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:12.823864 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a94d0-b2b9-480a-9bc5-2ad2fda421d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:12.880769 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a77a94d0-b2b9-480a-9bc5-2ad2fda421d1 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:30:12.881972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a77a94d0-b2b9-480a-9bc5-2ad2fda421d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:12.956222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:12.968685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 591/1185] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:30:12.979125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:30:12.980353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:13.080100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b4de5-a300-4826-ad0c-6c7d1ce2d42c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:30:13.134051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:13.154288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9904e-cf4d-4a27-bc20-eb49b96ee3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:30:13.154947 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9904e-cf4d-4a27-bc20-eb49b96ee3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:13.155227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9904e-cf4d-4a27-bc20-eb49b96ee3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:13.155497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9904e-cf4d-4a27-bc20-eb49b96ee3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:13.157146 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b9e9904e-cf4d-4a27-bc20-eb49b96ee3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:13.264879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9904e-cf4d-4a27-bc20-eb49b96ee3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:30:13.266213 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9904e-cf4d-4a27-bc20-eb49b96ee3f6 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:30:13.284978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 595/1186] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:30:13.629236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a94d0-b2b9-480a-9bc5-2ad2fda421d1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:30:13.630494 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a77a94d0-b2b9-480a-9bc5-2ad2fda421d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:30:13.642393 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a94d0-b2b9-480a-9bc5-2ad2fda421d1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:30:13.740755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:30:13.741383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:30:13.741757 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:30:13.742133 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] PATH_INFO: `/v3/projects/4b8fce5f847242f797336ff9db8809b6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:30:13.751841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8fce5f847242f797336ff9db8809b6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:30:13.752889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:30:13.752889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Nov 02 03:30:13.752889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: Nov 02 03:30:13.754069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:30:13.813957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8fce5f847242f797336ff9db8809b6', 'request_id': 'req-76bd2794-b9ba-453f-b9c0-f73372d2cc61'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:30:13.820687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8fce5f847242f797336ff9db8809b6', 'request_id': 'req-76bd2794-b9ba-453f-b9c0-f73372d2cc61'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:30:13.835926 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8fce5f847242f797336ff9db8809b6', 'request_id': 'req-76bd2794-b9ba-453f-b9c0-f73372d2cc61'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:30:13.862191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] The token cache is being invalidate because project 4b8fce5f847242f797336ff9db8809b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:30:13.862480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:30:13.862994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76bd2794-b9ba-453f-b9c0-f73372d2cc61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:30:13.864279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 592/1187] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:30:13 2022] DELETE /identity/v3/projects/4b8fce5f847242f797336ff9db8809b6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:30:23.282669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=62 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:30:23.859985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:31:46.122115 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a99e08-9a64-4d0b-b154-c3fbf3cdf173 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:46.122678 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a99e08-9a64-4d0b-b154-c3fbf3cdf173 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:46.122678 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a99e08-9a64-4d0b-b154-c3fbf3cdf173 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:46.124050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 596/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:31:46.128855 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3cd56-d065-40ed-85c0-836910b48386 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:46.129299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3cd56-d065-40ed-85c0-836910b48386 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:46.129402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3cd56-d065-40ed-85c0-836910b48386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:46.212006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ade3cd56-d065-40ed-85c0-836910b48386 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:31:46.213238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ade3cd56-d065-40ed-85c0-836910b48386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:31:46.318134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 593/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:31:46.472388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a99e08-9a64-4d0b-b154-c3fbf3cdf173 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:31:46.474501 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d6a99e08-9a64-4d0b-b154-c3fbf3cdf173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:31:46.595875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a99e08-9a64-4d0b-b154-c3fbf3cdf173 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:31:46.601224 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef10e87-ddca-491c-9007-004153c4fe51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:31:46.601858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10e87-ddca-491c-9007-004153c4fe51 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:46.603055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10e87-ddca-491c-9007-004153c4fe51 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:46.603055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef10e87-ddca-491c-9007-004153c4fe51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:46.611051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef10e87-ddca-491c-9007-004153c4fe51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:31:46.612940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef10e87-ddca-491c-9007-004153c4fe51 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:31:46.622557 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 597/1190] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:31:47.685705 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3158569-b048-4254-a3dd-81618ed12f87 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:47.686302 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3158569-b048-4254-a3dd-81618ed12f87 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:47.686302 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3158569-b048-4254-a3dd-81618ed12f87 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:47.687623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 594/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:31:47.692413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b9b8-fb36-4728-83c9-5ac7d3c2d51f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:47.692825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b9b8-fb36-4728-83c9-5ac7d3c2d51f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:47.692997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b9b8-fb36-4728-83c9-5ac7d3c2d51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:47.712490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-00a8b9b8-fb36-4728-83c9-5ac7d3c2d51f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:31:47.713738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-00a8b9b8-fb36-4728-83c9-5ac7d3c2d51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:31:47.721698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 598/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:31:47.875938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3158569-b048-4254-a3dd-81618ed12f87 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:31:47.890892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3158569-b048-4254-a3dd-81618ed12f87 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:31:47.896353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49be7af-f047-44c1-92d2-f270d253b656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:31:47.896982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49be7af-f047-44c1-92d2-f270d253b656 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:47.897264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49be7af-f047-44c1-92d2-f270d253b656 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:47.897538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49be7af-f047-44c1-92d2-f270d253b656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:47.905769 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49be7af-f047-44c1-92d2-f270d253b656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:31:47.907343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49be7af-f047-44c1-92d2-f270d253b656 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:31:47.918319 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 595/1193] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:31:47.942874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde697f7-d96e-4611-91e8-e2814f6f4263 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:47.943106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde697f7-d96e-4611-91e8-e2814f6f4263 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:47.943382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde697f7-d96e-4611-91e8-e2814f6f4263 None None] PATH_INFO: `/v3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:47.944720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 599/1194] 10.222.0.25 () {54 vars in 925 bytes} [Wed Nov 2 03:31:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:31:47.951328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48be8-60d9-4d2b-9063-e92c6c4e2b41 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:47.951577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48be8-60d9-4d2b-9063-e92c6c4e2b41 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:47.951854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48be8-60d9-4d2b-9063-e92c6c4e2b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:48.019656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-94b48be8-60d9-4d2b-9063-e92c6c4e2b41 None None] MFA Rules not processed for user `91b2777a51af45f5a86627d840f5b814`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:31:48.020945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-94b48be8-60d9-4d2b-9063-e92c6c4e2b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:31:48.042246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:31:48.100306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 596/1195] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Nov 2 03:31:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:31:56.913992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7f32f-c621-4a82-85b3-7f52020e5c27 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:56.914992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7f32f-c621-4a82-85b3-7f52020e5c27 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:56.915102 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7f32f-c621-4a82-85b3-7f52020e5c27 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:56.916510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 600/1196] 10.222.0.20 () {54 vars in 961 bytes} [Wed Nov 2 03:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:31:56.921772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc25a-2bc7-404e-b3eb-871d60f2cb96 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:56.922199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc25a-2bc7-404e-b3eb-871d60f2cb96 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:56.922327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc25a-2bc7-404e-b3eb-871d60f2cb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:56.942062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f3afc25a-2bc7-404e-b3eb-871d60f2cb96 None None] MFA Rules not processed for user `91b2777a51af45f5a86627d840f5b814`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:31:56.943259 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f3afc25a-2bc7-404e-b3eb-871d60f2cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:31:56.952349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 597/1197] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Nov 2 03:31:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:31:56.960188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7f32f-c621-4a82-85b3-7f52020e5c27 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:31:56.973306 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7f32f-c621-4a82-85b3-7f52020e5c27 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:31:56.978969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514358a1-eb02-4fdd-b71d-ab854e5a0fc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:31:56.979550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514358a1-eb02-4fdd-b71d-ab854e5a0fc6 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:56.979825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514358a1-eb02-4fdd-b71d-ab854e5a0fc6 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:56.980095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514358a1-eb02-4fdd-b71d-ab854e5a0fc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:56.988310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514358a1-eb02-4fdd-b71d-ab854e5a0fc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:31:56.989902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514358a1-eb02-4fdd-b71d-ab854e5a0fc6 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:31:56.999855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 601/1198] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:31:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:31:59.388525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9695dc-16cf-4157-811f-c7332c79a34f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:59.389070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9695dc-16cf-4157-811f-c7332c79a34f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:59.389070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9695dc-16cf-4157-811f-c7332c79a34f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:59.390353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 598/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:31:59.395252 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96b0b5-b2dc-4b2b-a70a-5c3a28e2ee43 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:59.395683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96b0b5-b2dc-4b2b-a70a-5c3a28e2ee43 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:59.395799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96b0b5-b2dc-4b2b-a70a-5c3a28e2ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:59.415846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0c96b0b5-b2dc-4b2b-a70a-5c3a28e2ee43 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:31:59.417061 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0c96b0b5-b2dc-4b2b-a70a-5c3a28e2ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:31:59.424824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 602/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:31:59.582588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9695dc-16cf-4157-811f-c7332c79a34f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:31:59.597723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9695dc-16cf-4157-811f-c7332c79a34f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:31:59.603807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83588d3-cfd0-4d2f-8b05-e46f2a98360a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:31:59.604402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83588d3-cfd0-4d2f-8b05-e46f2a98360a service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:31:59.604709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83588d3-cfd0-4d2f-8b05-e46f2a98360a service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:31:59.604985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83588d3-cfd0-4d2f-8b05-e46f2a98360a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:31:59.613105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83588d3-cfd0-4d2f-8b05-e46f2a98360a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:31:59.614660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83588d3-cfd0-4d2f-8b05-e46f2a98360a service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:31:59.623929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 599/1201] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:32:00.708815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137ac1-edd0-4f3d-ad29-d5e2029ce610 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:00.709345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137ac1-edd0-4f3d-ad29-d5e2029ce610 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:00.709462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137ac1-edd0-4f3d-ad29-d5e2029ce610 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:00.710755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 603/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 03:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:32:00.715556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12af045-5a25-44e7-9103-e4408bf56a38 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:00.715988 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12af045-5a25-44e7-9103-e4408bf56a38 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:00.716092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12af045-5a25-44e7-9103-e4408bf56a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:00.735852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c12af045-5a25-44e7-9103-e4408bf56a38 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:32:00.737337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c12af045-5a25-44e7-9103-e4408bf56a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:32:00.745950 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 600/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 03:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:32:00.895880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad137ac1-edd0-4f3d-ad29-d5e2029ce610 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:32:00.910481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad137ac1-edd0-4f3d-ad29-d5e2029ce610 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:32:00.916733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9585c1-7ffc-40a2-a8fd-a557708d2c61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:32:00.917351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9585c1-7ffc-40a2-a8fd-a557708d2c61 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:00.917628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9585c1-7ffc-40a2-a8fd-a557708d2c61 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:00.917894 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9585c1-7ffc-40a2-a8fd-a557708d2c61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:00.925787 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9585c1-7ffc-40a2-a8fd-a557708d2c61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:32:00.927342 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9585c1-7ffc-40a2-a8fd-a557708d2c61 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:32:00.936875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 604/1204] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:32:05.180107 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8e49-9297-4cba-92e3-176b43076b4c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:05.181281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8e49-9297-4cba-92e3-176b43076b4c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:05.181281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8e49-9297-4cba-92e3-176b43076b4c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:05.182601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 601/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:32:05.187922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9c6a8-94c2-4a26-a1d1-08ca0a57a73e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:05.188358 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9c6a8-94c2-4a26-a1d1-08ca0a57a73e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:05.188504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9c6a8-94c2-4a26-a1d1-08ca0a57a73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:05.208284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b7c9c6a8-94c2-4a26-a1d1-08ca0a57a73e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:32:05.209518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b7c9c6a8-94c2-4a26-a1d1-08ca0a57a73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:32:05.218138 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 605/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:32:05.509327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f8e49-9297-4cba-92e3-176b43076b4c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:32:05.511108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-650f8e49-9297-4cba-92e3-176b43076b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:32:05.592626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f8e49-9297-4cba-92e3-176b43076b4c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:32:05.596184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19ffe0-a7d2-45a1-8b49-05bfba4e16c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:32:05.596829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19ffe0-a7d2-45a1-8b49-05bfba4e16c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:05.597109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19ffe0-a7d2-45a1-8b49-05bfba4e16c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:05.597381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19ffe0-a7d2-45a1-8b49-05bfba4e16c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:05.606187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19ffe0-a7d2-45a1-8b49-05bfba4e16c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:32:05.607600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19ffe0-a7d2-45a1-8b49-05bfba4e16c3 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:32:05.617073 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 602/1207] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:32:07.749207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86e02-f39e-4ad4-b174-99efbb81caa4 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:07.749761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86e02-f39e-4ad4-b174-99efbb81caa4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:07.749761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86e02-f39e-4ad4-b174-99efbb81caa4 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:07.751157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 606/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:32:07.756448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8bf22-e4b7-4c60-bbfb-b6fde151c70f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:07.756838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8bf22-e4b7-4c60-bbfb-b6fde151c70f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:07.757035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8bf22-e4b7-4c60-bbfb-b6fde151c70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:07.779248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a9f8bf22-e4b7-4c60-bbfb-b6fde151c70f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:32:07.780444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a9f8bf22-e4b7-4c60-bbfb-b6fde151c70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:32:07.788351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 603/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:32:08.084019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda86e02-f39e-4ad4-b174-99efbb81caa4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:32:08.095285 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda86e02-f39e-4ad4-b174-99efbb81caa4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:32:08.098811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ca877-576b-4fe7-a0a0-96e4d8fc0fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:32:08.099408 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ca877-576b-4fe7-a0a0-96e4d8fc0fbd service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:08.099691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ca877-576b-4fe7-a0a0-96e4d8fc0fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:08.099966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ca877-576b-4fe7-a0a0-96e4d8fc0fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:08.109985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ca877-576b-4fe7-a0a0-96e4d8fc0fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:32:08.111406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ca877-576b-4fe7-a0a0-96e4d8fc0fbd service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:32:08.121888 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 607/1210] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:32:11.686115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6b910-5bd3-40a6-a021-a832ed2337d0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:11.686771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6b910-5bd3-40a6-a021-a832ed2337d0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:11.686771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6b910-5bd3-40a6-a021-a832ed2337d0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:11.687911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 604/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:32:11.693250 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b42336-2b8d-4eac-8a3c-64d4812332d8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:11.693688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b42336-2b8d-4eac-8a3c-64d4812332d8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:11.693795 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b42336-2b8d-4eac-8a3c-64d4812332d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:11.713968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b8b42336-2b8d-4eac-8a3c-64d4812332d8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:32:11.715150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b8b42336-2b8d-4eac-8a3c-64d4812332d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:32:11.723128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 608/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:32:12.025439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6b910-5bd3-40a6-a021-a832ed2337d0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:32:12.027107 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-02a6b910-5bd3-40a6-a021-a832ed2337d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:32:12.092556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:32:12.106110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6b910-5bd3-40a6-a021-a832ed2337d0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:32:12.109716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6c050-b32a-449a-8985-ce1348411735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:32:12.110349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6c050-b32a-449a-8985-ce1348411735 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:12.110629 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6c050-b32a-449a-8985-ce1348411735 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:12.110899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6c050-b32a-449a-8985-ce1348411735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:12.120801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6c050-b32a-449a-8985-ce1348411735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:32:12.122217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6c050-b32a-449a-8985-ce1348411735 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:32:12.131370 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 605/1213] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:32:14.287436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001783ed-b3a7-4a5f-94ce-bd9ac685e33d None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:14.287998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001783ed-b3a7-4a5f-94ce-bd9ac685e33d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:14.287998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001783ed-b3a7-4a5f-94ce-bd9ac685e33d None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:14.289382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 609/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 03:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:32:14.294774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291df0a5-8eba-48ae-baef-c016af89f0ca None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:14.295243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291df0a5-8eba-48ae-baef-c016af89f0ca None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:14.295346 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291df0a5-8eba-48ae-baef-c016af89f0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:14.315146 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-291df0a5-8eba-48ae-baef-c016af89f0ca None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:32:14.316336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-291df0a5-8eba-48ae-baef-c016af89f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:32:14.325172 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 606/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 03:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:32:14.626433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001783ed-b3a7-4a5f-94ce-bd9ac685e33d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:32:14.628081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-001783ed-b3a7-4a5f-94ce-bd9ac685e33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:32:14.636219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=84 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:32:14.642788 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001783ed-b3a7-4a5f-94ce-bd9ac685e33d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:32:14.646348 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863fec0-8030-49ec-bad2-858bb4d2b140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:32:14.647002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863fec0-8030-49ec-bad2-858bb4d2b140 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:32:14.647281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863fec0-8030-49ec-bad2-858bb4d2b140 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:32:14.647550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863fec0-8030-49ec-bad2-858bb4d2b140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:32:14.657144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863fec0-8030-49ec-bad2-858bb4d2b140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:32:14.658558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863fec0-8030-49ec-bad2-858bb4d2b140 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:32:14.668171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 610/1216] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:32:24.310401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=11 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:32:24.663680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:48.457973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fb050-9383-4e36-9545-ddbac9b6b4b0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.459337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fb050-9383-4e36-9545-ddbac9b6b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.459902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fb050-9383-4e36-9545-ddbac9b6b4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.487625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-329fb050-9383-4e36-9545-ddbac9b6b4b0 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:48.489357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-329fb050-9383-4e36-9545-ddbac9b6b4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:48.503096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 607/1217] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:48.514467 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b07215-7516-48c6-ab39-74b198dfcfae None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.515718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b07215-7516-48c6-ab39-74b198dfcfae None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.516225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b07215-7516-48c6-ab39-74b198dfcfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.544245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-58b07215-7516-48c6-ab39-74b198dfcfae None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:48.545532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-58b07215-7516-48c6-ab39-74b198dfcfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:48.559855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 611/1218] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:48.564660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fb050-9383-4e36-9545-ddbac9b6b4b0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:48.577352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fb050-9383-4e36-9545-ddbac9b6b4b0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:48.584510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119002f4-6a3b-460a-9d1d-9a16163c9c45 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.584510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119002f4-6a3b-460a-9d1d-9a16163c9c45 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.584510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119002f4-6a3b-460a-9d1d-9a16163c9c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.589838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bffe2e-033b-442c-aad0-b2eab73742a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:48.590742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bffe2e-033b-442c-aad0-b2eab73742a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.591336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bffe2e-033b-442c-aad0-b2eab73742a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.591827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bffe2e-033b-442c-aad0-b2eab73742a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.592733 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bffe2e-033b-442c-aad0-b2eab73742a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:33:48.593265 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bffe2e-033b-442c-aad0-b2eab73742a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:48.595085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bffe2e-033b-442c-aad0-b2eab73742a6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:48.615930 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-119002f4-6a3b-460a-9d1d-9a16163c9c45 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:48.617232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-119002f4-6a3b-460a-9d1d-9a16163c9c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:48.617369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 608/1219] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:33:48.618734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97064eb4-8e5a-47c3-95e3-ca066cdbf154 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.619101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97064eb4-8e5a-47c3-95e3-ca066cdbf154 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.619474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97064eb4-8e5a-47c3-95e3-ca066cdbf154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.633964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 612/1220] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:48.634633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119002f4-6a3b-460a-9d1d-9a16163c9c45 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:48.657430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-97064eb4-8e5a-47c3-95e3-ca066cdbf154 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:48.658841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-97064eb4-8e5a-47c3-95e3-ca066cdbf154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:48.659594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119002f4-6a3b-460a-9d1d-9a16163c9c45 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:48.669252 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5951f9-5e89-4b49-be77-b5f3fe537635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:48.670008 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5951f9-5e89-4b49-be77-b5f3fe537635 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.670258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5951f9-5e89-4b49-be77-b5f3fe537635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.670530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5951f9-5e89-4b49-be77-b5f3fe537635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.671539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5951f9-5e89-4b49-be77-b5f3fe537635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:48.673200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5951f9-5e89-4b49-be77-b5f3fe537635 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:48.687031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 609/1221] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:48.688933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb308216-666e-4c2d-a776-a16eac1a21fd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.689402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb308216-666e-4c2d-a776-a16eac1a21fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.689695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb308216-666e-4c2d-a776-a16eac1a21fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.754935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fb308216-666e-4c2d-a776-a16eac1a21fd None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:48.756225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fb308216-666e-4c2d-a776-a16eac1a21fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:48.771332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 613/1222] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:48.771332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ed1ec-8721-42a4-b8a4-c9f44229f125 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.771332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ed1ec-8721-42a4-b8a4-c9f44229f125 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.771332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ed1ec-8721-42a4-b8a4-c9f44229f125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.812742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8a9ed1ec-8721-42a4-b8a4-c9f44229f125 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:48.813964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8a9ed1ec-8721-42a4-b8a4-c9f44229f125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:48.866455 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 610/1223] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:48.867318 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb308216-666e-4c2d-a776-a16eac1a21fd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:48.885201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb308216-666e-4c2d-a776-a16eac1a21fd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:48.902191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17685c99-ae53-409b-a28a-7e1cc0acf6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:48.902822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17685c99-ae53-409b-a28a-7e1cc0acf6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.903106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17685c99-ae53-409b-a28a-7e1cc0acf6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.903379 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17685c99-ae53-409b-a28a-7e1cc0acf6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.904022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17685c99-ae53-409b-a28a-7e1cc0acf6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:48.906099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17685c99-ae53-409b-a28a-7e1cc0acf6a2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:48.931190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 614/1224] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:48.932487 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef756f-b7d7-41d4-9eb9-9fb3806d1e9d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.932861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef756f-b7d7-41d4-9eb9-9fb3806d1e9d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.933141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef756f-b7d7-41d4-9eb9-9fb3806d1e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.940600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 611/1225] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/users => generated 293 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:48.940600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e921-22d0-42a5-bde7-6172e75ee482 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.941007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e921-22d0-42a5-bde7-6172e75ee482 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.943054 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e921-22d0-42a5-bde7-6172e75ee482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.957445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-efef756f-b7d7-41d4-9eb9-9fb3806d1e9d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:48.958649 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-efef756f-b7d7-41d4-9eb9-9fb3806d1e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:48.963947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e629e921-22d0-42a5-bde7-6172e75ee482 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:48.965168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e629e921-22d0-42a5-bde7-6172e75ee482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:48.967076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 615/1226] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:48.971539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef756f-b7d7-41d4-9eb9-9fb3806d1e9d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:48.976612 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 612/1227] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:48.978537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1e006-d81d-4077-834c-b18c9bfbece9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.979676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1e006-d81d-4077-834c-b18c9bfbece9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.980183 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1e006-d81d-4077-834c-b18c9bfbece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.983045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef756f-b7d7-41d4-9eb9-9fb3806d1e9d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:48.987882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981824f-a311-4b11-aef4-525e77643f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:48.988506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981824f-a311-4b11-aef4-525e77643f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:48.988792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981824f-a311-4b11-aef4-525e77643f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:48.989068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981824f-a311-4b11-aef4-525e77643f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:48.989716 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981824f-a311-4b11-aef4-525e77643f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:33:48.990022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981824f-a311-4b11-aef4-525e77643f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:48.991351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-5981824f-a311-4b11-aef4-525e77643f12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:33:48.991351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: warnings.warn(msg) Nov 02 03:33:48.991351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: Nov 02 03:33:48.992234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981824f-a311-4b11-aef4-525e77643f12 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.001498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c1c1e006-d81d-4077-834c-b18c9bfbece9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:49.002864 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c1c1e006-d81d-4077-834c-b18c9bfbece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:49.004158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 616/1228] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:33:49.005123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981824f-a311-4b11-aef4-525e77643f12 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.016749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 613/1229] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:49.016749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1e006-d81d-4077-834c-b18c9bfbece9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.020971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981824f-a311-4b11-aef4-525e77643f12 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.022541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1e006-d81d-4077-834c-b18c9bfbece9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.026558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34276dfa-61b1-4812-bfd6-5031ad02bfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.027162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34276dfa-61b1-4812-bfd6-5031ad02bfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.027383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec0dca-01af-4640-b10b-08dfc90312c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.027510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34276dfa-61b1-4812-bfd6-5031ad02bfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.027700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34276dfa-61b1-4812-bfd6-5031ad02bfe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.027984 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0dca-01af-4640-b10b-08dfc90312c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.028266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0dca-01af-4640-b10b-08dfc90312c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.028375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34276dfa-61b1-4812-bfd6-5031ad02bfe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:33:49.028584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0dca-01af-4640-b10b-08dfc90312c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.028694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34276dfa-61b1-4812-bfd6-5031ad02bfe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.029234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec0dca-01af-4640-b10b-08dfc90312c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.030259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34276dfa-61b1-4812-bfd6-5031ad02bfe9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.030809 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec0dca-01af-4640-b10b-08dfc90312c7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.044565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 614/1230] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:49.044771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 617/1231] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:33:49.044871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba84c7c-9b00-4837-9cd0-044cc16d2209 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.044871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba84c7c-9b00-4837-9cd0-044cc16d2209 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.044871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba84c7c-9b00-4837-9cd0-044cc16d2209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.045123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f01a4f-a5fd-4f0c-ad1a-ad014efce1ed None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.045123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f01a4f-a5fd-4f0c-ad1a-ad014efce1ed None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.045543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f01a4f-a5fd-4f0c-ad1a-ad014efce1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.066838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5ba84c7c-9b00-4837-9cd0-044cc16d2209 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:49.067477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-35f01a4f-a5fd-4f0c-ad1a-ad014efce1ed None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:49.068052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5ba84c7c-9b00-4837-9cd0-044cc16d2209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:49.068669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-35f01a4f-a5fd-4f0c-ad1a-ad014efce1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:49.077085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 615/1232] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:49.078514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe01a7-be3f-49c9-9a03-e9ff8acdc062 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.078737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe01a7-be3f-49c9-9a03-e9ff8acdc062 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.079089 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe01a7-be3f-49c9-9a03-e9ff8acdc062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.084365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 618/1233] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:49.085781 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c544f-ce7e-47cc-9d75-a13f80b0cde6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.086068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c544f-ce7e-47cc-9d75-a13f80b0cde6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.086341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c544f-ce7e-47cc-9d75-a13f80b0cde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.107648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8c5c544f-ce7e-47cc-9d75-a13f80b0cde6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:49.108621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-28fe01a7-be3f-49c9-9a03-e9ff8acdc062 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:49.108880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8c5c544f-ce7e-47cc-9d75-a13f80b0cde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:49.109933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-28fe01a7-be3f-49c9-9a03-e9ff8acdc062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:49.118826 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 619/1234] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:49.119826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 616/1235] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:49.123532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87da7af-4be6-47a6-8c68-96b942abb1d8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.123532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87da7af-4be6-47a6-8c68-96b942abb1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.123532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87da7af-4be6-47a6-8c68-96b942abb1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.123804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c544f-ce7e-47cc-9d75-a13f80b0cde6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.133635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c544f-ce7e-47cc-9d75-a13f80b0cde6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.138246 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9cb45-d07d-4c16-8629-bc3009d84e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.138852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9cb45-d07d-4c16-8629-bc3009d84e05 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.139127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9cb45-d07d-4c16-8629-bc3009d84e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.139396 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9cb45-d07d-4c16-8629-bc3009d84e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.140023 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9cb45-d07d-4c16-8629-bc3009d84e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.141976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9cb45-d07d-4c16-8629-bc3009d84e05 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.144329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e87da7af-4be6-47a6-8c68-96b942abb1d8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:49.145640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e87da7af-4be6-47a6-8c68-96b942abb1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:49.155301 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 617/1236] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:49.159045 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87da7af-4be6-47a6-8c68-96b942abb1d8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.167797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87da7af-4be6-47a6-8c68-96b942abb1d8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.173150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 620/1237] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:49.174099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9cb45-d07d-4c16-8629-bc3009d84e05 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.177039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b550a4f-bf6f-4d8b-9c24-fac93bb96c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.177666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550a4f-bf6f-4d8b-9c24-fac93bb96c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.177957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550a4f-bf6f-4d8b-9c24-fac93bb96c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.179012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550a4f-bf6f-4d8b-9c24-fac93bb96c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.179682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b550a4f-bf6f-4d8b-9c24-fac93bb96c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.181339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b550a4f-bf6f-4d8b-9c24-fac93bb96c59 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.193159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 618/1238] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:49.195469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc87f2-6891-4c69-a996-040528e6354e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.196718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc87f2-6891-4c69-a996-040528e6354e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.197013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc87f2-6891-4c69-a996-040528e6354e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.216715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-49cc87f2-6891-4c69-a996-040528e6354e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:49.217930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-49cc87f2-6891-4c69-a996-040528e6354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:49.228247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:49.243863 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9cb45-d07d-4c16-8629-bc3009d84e05 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.249040 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41543c34-066b-4b32-9d33-274323affae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.249655 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41543c34-066b-4b32-9d33-274323affae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.249937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41543c34-066b-4b32-9d33-274323affae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.250237 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41543c34-066b-4b32-9d33-274323affae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.250867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41543c34-066b-4b32-9d33-274323affae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.252949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41543c34-066b-4b32-9d33-274323affae2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.281437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 621/1239] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:49.287111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 619/1240] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:49.287304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4da4-a67e-4421-9aeb-dde50b475782 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.287304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4da4-a67e-4421-9aeb-dde50b475782 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.287529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc87f2-6891-4c69-a996-040528e6354e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.287662 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa4da4-a67e-4421-9aeb-dde50b475782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.289212 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:49.294208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc87f2-6891-4c69-a996-040528e6354e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.304842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-51fa4da4-a67e-4421-9aeb-dde50b475782 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:49.306060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-51fa4da4-a67e-4421-9aeb-dde50b475782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:49.354681 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662674e1-6d6a-4095-b82b-a89a78596964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.355329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662674e1-6d6a-4095-b82b-a89a78596964 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.355675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662674e1-6d6a-4095-b82b-a89a78596964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.355950 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662674e1-6d6a-4095-b82b-a89a78596964 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.356676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662674e1-6d6a-4095-b82b-a89a78596964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:33:49.356979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662674e1-6d6a-4095-b82b-a89a78596964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.358603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662674e1-6d6a-4095-b82b-a89a78596964 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.366993 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 622/1241] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:49.367850 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4da4-a67e-4421-9aeb-dde50b475782 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.371058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 620/1242] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:33:49.377376 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662674e1-6d6a-4095-b82b-a89a78596964 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.377534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa4da4-a67e-4421-9aeb-dde50b475782 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.382863 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38f776-fb34-4b17-ab05-d971b7a6d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.383472 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38f776-fb34-4b17-ab05-d971b7a6d459 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.383754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38f776-fb34-4b17-ab05-d971b7a6d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.384032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38f776-fb34-4b17-ab05-d971b7a6d459 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.384714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38f776-fb34-4b17-ab05-d971b7a6d459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:33:49.385020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38f776-fb34-4b17-ab05-d971b7a6d459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.386679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38f776-fb34-4b17-ab05-d971b7a6d459 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.388430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662674e1-6d6a-4095-b82b-a89a78596964 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.394029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f2722-75da-452c-bab3-dce2769322b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.394621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f2722-75da-452c-bab3-dce2769322b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.394907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f2722-75da-452c-bab3-dce2769322b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.395634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f2722-75da-452c-bab3-dce2769322b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.396282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f2722-75da-452c-bab3-dce2769322b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:33:49.396624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f2722-75da-452c-bab3-dce2769322b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.398707 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 623/1243] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:33:49.398962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f2722-75da-452c-bab3-dce2769322b6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.399481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38f776-fb34-4b17-ab05-d971b7a6d459 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.410320 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38f776-fb34-4b17-ab05-d971b7a6d459 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.412042 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 621/1244] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:33:49.412831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f2722-75da-452c-bab3-dce2769322b6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.422731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f2722-75da-452c-bab3-dce2769322b6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.423447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb65917-8371-4b5e-b5b6-352d9db7bafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.424071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb65917-8371-4b5e-b5b6-352d9db7bafe admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.424355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb65917-8371-4b5e-b5b6-352d9db7bafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.424662 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb65917-8371-4b5e-b5b6-352d9db7bafe admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.425301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb65917-8371-4b5e-b5b6-352d9db7bafe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.426319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-fdb65917-8371-4b5e-b5b6-352d9db7bafe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:33:49.426319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: warnings.warn(msg) Nov 02 03:33:49.426319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: Nov 02 03:33:49.427593 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f8bbe-8837-4dad-82ad-37b967ea1f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.427730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb65917-8371-4b5e-b5b6-352d9db7bafe admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.428280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8bbe-8837-4dad-82ad-37b967ea1f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.428595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8bbe-8837-4dad-82ad-37b967ea1f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.428899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8bbe-8837-4dad-82ad-37b967ea1f47 admin admin] PATH_INFO: `/v3/projects/2647ae424107471bb395d52ad56bd894/users/e0281fe66a8047f7ae0d8d7d48dc8470/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.445854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f8bbe-8837-4dad-82ad-37b967ea1f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2647ae424107471bb395d52ad56bd894, user_id=e0281fe66a8047f7ae0d8d7d48dc8470, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.448542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f8bbe-8837-4dad-82ad-37b967ea1f47 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.450906 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 624/1245] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:49.451709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb65917-8371-4b5e-b5b6-352d9db7bafe admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.464107 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 622/1246] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:33:49 2022] PUT /identity/v3/projects/2647ae424107471bb395d52ad56bd894/users/e0281fe66a8047f7ae0d8d7d48dc8470/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:49.465298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f8bbe-8837-4dad-82ad-37b967ea1f47 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.465462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb65917-8371-4b5e-b5b6-352d9db7bafe admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.521811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a81101-0f2b-43ea-bd5d-24347f725db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.522543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a81101-0f2b-43ea-bd5d-24347f725db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.522731 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a81101-0f2b-43ea-bd5d-24347f725db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.522973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a81101-0f2b-43ea-bd5d-24347f725db2 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.523599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a81101-0f2b-43ea-bd5d-24347f725db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.525537 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a81101-0f2b-43ea-bd5d-24347f725db2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.529043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f8bbe-8837-4dad-82ad-37b967ea1f47 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.533718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e112b48-4f6d-4d78-9dc4-aa263571a6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.534271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e112b48-4f6d-4d78-9dc4-aa263571a6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.534665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e112b48-4f6d-4d78-9dc4-aa263571a6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.534946 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e112b48-4f6d-4d78-9dc4-aa263571a6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.535593 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e112b48-4f6d-4d78-9dc4-aa263571a6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:33:49.536013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e112b48-4f6d-4d78-9dc4-aa263571a6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.538200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e112b48-4f6d-4d78-9dc4-aa263571a6e8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.547140 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 625/1247] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:49.548039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a81101-0f2b-43ea-bd5d-24347f725db2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.562797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 623/1248] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:33:49.562797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e112b48-4f6d-4d78-9dc4-aa263571a6e8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.563099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a81101-0f2b-43ea-bd5d-24347f725db2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.567180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bc399-4372-4a1b-aa04-6f872b3b304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.567780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bc399-4372-4a1b-aa04-6f872b3b304f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.568165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bc399-4372-4a1b-aa04-6f872b3b304f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.568352 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bc399-4372-4a1b-aa04-6f872b3b304f admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.569039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e112b48-4f6d-4d78-9dc4-aa263571a6e8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.569228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bc399-4372-4a1b-aa04-6f872b3b304f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:33:49.569629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bc399-4372-4a1b-aa04-6f872b3b304f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.571223 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bc399-4372-4a1b-aa04-6f872b3b304f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.574052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef4def-e58b-4c68-9f75-f30b9dbecb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.574668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef4def-e58b-4c68-9f75-f30b9dbecb62 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.574997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef4def-e58b-4c68-9f75-f30b9dbecb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.575272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef4def-e58b-4c68-9f75-f30b9dbecb62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.575885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef4def-e58b-4c68-9f75-f30b9dbecb62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.576919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-14ef4def-e58b-4c68-9f75-f30b9dbecb62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:33:49.576919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Nov 02 03:33:49.576919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: Nov 02 03:33:49.578083 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef4def-e58b-4c68-9f75-f30b9dbecb62 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.584266 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 626/1249] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:33:49.592812 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bc399-4372-4a1b-aa04-6f872b3b304f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.603834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bc399-4372-4a1b-aa04-6f872b3b304f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.609498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 624/1250] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:49.609498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef4def-e58b-4c68-9f75-f30b9dbecb62 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.609730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5afd-1068-4c85-8e2b-b728267a77f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.609730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5afd-1068-4c85-8e2b-b728267a77f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.609730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5afd-1068-4c85-8e2b-b728267a77f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.610009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5afd-1068-4c85-8e2b-b728267a77f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.610396 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5afd-1068-4c85-8e2b-b728267a77f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.612671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5afd-1068-4c85-8e2b-b728267a77f6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.633426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:49.644334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 627/1251] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:49.644545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:49.644665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5afd-1068-4c85-8e2b-b728267a77f6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.674822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef4def-e58b-4c68-9f75-f30b9dbecb62 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.707665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5afd-1068-4c85-8e2b-b728267a77f6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.712833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad907b6a-4826-408e-bb3a-4500213085b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.713443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907b6a-4826-408e-bb3a-4500213085b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.713722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907b6a-4826-408e-bb3a-4500213085b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.713991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907b6a-4826-408e-bb3a-4500213085b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.714644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad907b6a-4826-408e-bb3a-4500213085b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.716225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad907b6a-4826-408e-bb3a-4500213085b3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.726635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 628/1252] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:49.727811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f7af-8cf2-4103-937f-18244d59274e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.728092 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f7af-8cf2-4103-937f-18244d59274e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.728562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f7af-8cf2-4103-937f-18244d59274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.734282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3ada9-25f3-44ec-90b6-9f7696686d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.734907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3ada9-25f3-44ec-90b6-9f7696686d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.735211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3ada9-25f3-44ec-90b6-9f7696686d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.735512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3ada9-25f3-44ec-90b6-9f7696686d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.736183 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3ada9-25f3-44ec-90b6-9f7696686d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.738489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3ada9-25f3-44ec-90b6-9f7696686d44 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.747945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-62e5f7af-8cf2-4103-937f-18244d59274e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:49.749595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-62e5f7af-8cf2-4103-937f-18244d59274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:49.758533 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 629/1253] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:49.759652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5f7af-8cf2-4103-937f-18244d59274e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.770224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 625/1254] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:49.771041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3ada9-25f3-44ec-90b6-9f7696686d44 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.771231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5f7af-8cf2-4103-937f-18244d59274e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.836752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08339d-de23-450b-a6b0-2639af9eef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.837285 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08339d-de23-450b-a6b0-2639af9eef72 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.837688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08339d-de23-450b-a6b0-2639af9eef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.837968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08339d-de23-450b-a6b0-2639af9eef72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.838614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08339d-de23-450b-a6b0-2639af9eef72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.840221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08339d-de23-450b-a6b0-2639af9eef72 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.844120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3ada9-25f3-44ec-90b6-9f7696686d44 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.849034 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35595-2e9c-4659-abfb-e52154bec5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.849643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35595-2e9c-4659-abfb-e52154bec5da admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.849935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35595-2e9c-4659-abfb-e52154bec5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.850786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 630/1255] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:49.850898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35595-2e9c-4659-abfb-e52154bec5da admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.851711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08339d-de23-450b-a6b0-2639af9eef72 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.851994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e35595-2e9c-4659-abfb-e52154bec5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.854017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e35595-2e9c-4659-abfb-e52154bec5da admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.862849 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08339d-de23-450b-a6b0-2639af9eef72 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.868124 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a57ab7-253a-4a36-af2d-584f06d50f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.868751 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57ab7-253a-4a36-af2d-584f06d50f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.869031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57ab7-253a-4a36-af2d-584f06d50f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.869303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57ab7-253a-4a36-af2d-584f06d50f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.869927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a57ab7-253a-4a36-af2d-584f06d50f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.871836 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a57ab7-253a-4a36-af2d-584f06d50f5d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.882043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 626/1256] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:49.882910 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35595-2e9c-4659-abfb-e52154bec5da admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.907425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 631/1257] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:49.907425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a57ab7-253a-4a36-af2d-584f06d50f5d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:49.937794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:49.952338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35595-2e9c-4659-abfb-e52154bec5da admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.971002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a57ab7-253a-4a36-af2d-584f06d50f5d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:49.975578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6283-c03f-4ee2-b4ee-f6d17fb83e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:49.976333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6283-c03f-4ee2-b4ee-f6d17fb83e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:49.976648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6283-c03f-4ee2-b4ee-f6d17fb83e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:49.976921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6283-c03f-4ee2-b4ee-f6d17fb83e66 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:49.977576 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd6283-c03f-4ee2-b4ee-f6d17fb83e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:49.979484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd6283-c03f-4ee2-b4ee-f6d17fb83e66 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:49.988501 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:50.001236 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 632/1258] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:50.002272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6283-c03f-4ee2-b4ee-f6d17fb83e66 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.010985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d0391-9e6e-4126-ba5a-aee1d678ca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.011599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d0391-9e6e-4126-ba5a-aee1d678ca33 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.011882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d0391-9e6e-4126-ba5a-aee1d678ca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.012076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6283-c03f-4ee2-b4ee-f6d17fb83e66 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.012214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d0391-9e6e-4126-ba5a-aee1d678ca33 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.012811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d0391-9e6e-4126-ba5a-aee1d678ca33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.014702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d0391-9e6e-4126-ba5a-aee1d678ca33 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.016629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62db75-5dc6-479d-8a63-d2b3e4e32d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.017215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62db75-5dc6-479d-8a63-d2b3e4e32d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.017492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62db75-5dc6-479d-8a63-d2b3e4e32d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.017759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62db75-5dc6-479d-8a63-d2b3e4e32d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.018386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62db75-5dc6-479d-8a63-d2b3e4e32d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.020027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62db75-5dc6-479d-8a63-d2b3e4e32d94 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.031043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 633/1259] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.031853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62db75-5dc6-479d-8a63-d2b3e4e32d94 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.038627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 627/1260] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:33:49 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:50.039647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d0391-9e6e-4126-ba5a-aee1d678ca33 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.052017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d0391-9e6e-4126-ba5a-aee1d678ca33 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.057219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ced7bf-17c7-4923-8e65-b8d5e535039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.057847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ced7bf-17c7-4923-8e65-b8d5e535039f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.058134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ced7bf-17c7-4923-8e65-b8d5e535039f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.058405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ced7bf-17c7-4923-8e65-b8d5e535039f admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.059070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ced7bf-17c7-4923-8e65-b8d5e535039f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.061006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ced7bf-17c7-4923-8e65-b8d5e535039f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.087703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 628/1261] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:33:50 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:50.087703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ced7bf-17c7-4923-8e65-b8d5e535039f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.094397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ced7bf-17c7-4923-8e65-b8d5e535039f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.095389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62db75-5dc6-479d-8a63-d2b3e4e32d94 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.098970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55587-9bf9-408e-b467-0f0c6bdaf544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.099125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28b3f2-7e3f-428f-a0ca-2eb4e1393a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.099554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55587-9bf9-408e-b467-0f0c6bdaf544 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.099714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28b3f2-7e3f-428f-a0ca-2eb4e1393a54 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.099849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55587-9bf9-408e-b467-0f0c6bdaf544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.099981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28b3f2-7e3f-428f-a0ca-2eb4e1393a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.100140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55587-9bf9-408e-b467-0f0c6bdaf544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.100345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28b3f2-7e3f-428f-a0ca-2eb4e1393a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.100898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b55587-9bf9-408e-b467-0f0c6bdaf544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.102335 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b55587-9bf9-408e-b467-0f0c6bdaf544 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.109285 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28b3f2-7e3f-428f-a0ca-2eb4e1393a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.110711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28b3f2-7e3f-428f-a0ca-2eb4e1393a54 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.112874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 629/1262] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.116826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55587-9bf9-408e-b467-0f0c6bdaf544 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.122951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 634/1263] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:33:50.123781 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28b3f2-7e3f-428f-a0ca-2eb4e1393a54 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.123903 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55587-9bf9-408e-b467-0f0c6bdaf544 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.128659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfcde1-4d80-4e6c-b7fe-7a0a4c829523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.129742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfcde1-4d80-4e6c-b7fe-7a0a4c829523 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.130029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfcde1-4d80-4e6c-b7fe-7a0a4c829523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.130302 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfcde1-4d80-4e6c-b7fe-7a0a4c829523 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.131209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfcde1-4d80-4e6c-b7fe-7a0a4c829523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.133641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28b3f2-7e3f-428f-a0ca-2eb4e1393a54 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.133757 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfcde1-4d80-4e6c-b7fe-7a0a4c829523 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.138634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7259c-97cc-4ecf-b8c2-377e3fb43ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.139266 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7259c-97cc-4ecf-b8c2-377e3fb43ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.139545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7259c-97cc-4ecf-b8c2-377e3fb43ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.139817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7259c-97cc-4ecf-b8c2-377e3fb43ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.140440 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7259c-97cc-4ecf-b8c2-377e3fb43ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.142399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7259c-97cc-4ecf-b8c2-377e3fb43ac3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.157336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 630/1264] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:33:50 2022] POST /identity/v3/users => generated 303 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:50.161306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfcde1-4d80-4e6c-b7fe-7a0a4c829523 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.168035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 635/1265] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:33:50 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:50.168035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7259c-97cc-4ecf-b8c2-377e3fb43ac3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.173993 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfcde1-4d80-4e6c-b7fe-7a0a4c829523 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.178439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7259c-97cc-4ecf-b8c2-377e3fb43ac3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.179183 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d12fb-a3ae-40df-bf02-38c10422da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.179861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d12fb-a3ae-40df-bf02-38c10422da76 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.180211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d12fb-a3ae-40df-bf02-38c10422da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.180865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d12fb-a3ae-40df-bf02-38c10422da76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.182115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d12fb-a3ae-40df-bf02-38c10422da76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.183684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838fca2-6d66-450a-8c0f-c1235dd5494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.184407 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838fca2-6d66-450a-8c0f-c1235dd5494e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.184532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d12fb-a3ae-40df-bf02-38c10422da76 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.184830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838fca2-6d66-450a-8c0f-c1235dd5494e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.185170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838fca2-6d66-450a-8c0f-c1235dd5494e admin admin] PATH_INFO: `/v3/projects/8bd9b14312e84c35b017afb82ed9e06f/users/962b2af5884f493bb3ea707735fdb431/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.199026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 631/1266] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.200085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d12fb-a3ae-40df-bf02-38c10422da76 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.203425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838fca2-6d66-450a-8c0f-c1235dd5494e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd9b14312e84c35b017afb82ed9e06f, user_id=962b2af5884f493bb3ea707735fdb431, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.206390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838fca2-6d66-450a-8c0f-c1235dd5494e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.211868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d12fb-a3ae-40df-bf02-38c10422da76 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.216835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757945c-9243-4772-a41d-dde500ee79ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.217447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757945c-9243-4772-a41d-dde500ee79ed admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.217727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757945c-9243-4772-a41d-dde500ee79ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.218004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757945c-9243-4772-a41d-dde500ee79ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.218642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757945c-9243-4772-a41d-dde500ee79ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.220349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757945c-9243-4772-a41d-dde500ee79ed admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.222572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 636/1267] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:33:50 2022] PUT /identity/v3/projects/8bd9b14312e84c35b017afb82ed9e06f/users/962b2af5884f493bb3ea707735fdb431/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:50.223493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838fca2-6d66-450a-8c0f-c1235dd5494e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.239273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 632/1268] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.240490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757945c-9243-4772-a41d-dde500ee79ed admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.252642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757945c-9243-4772-a41d-dde500ee79ed admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.296970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838fca2-6d66-450a-8c0f-c1235dd5494e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.302443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa57807-e072-43b6-a5f9-e8f1a2ec701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.303169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa57807-e072-43b6-a5f9-e8f1a2ec701b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.303521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa57807-e072-43b6-a5f9-e8f1a2ec701b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.303815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa57807-e072-43b6-a5f9-e8f1a2ec701b admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.304916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa57807-e072-43b6-a5f9-e8f1a2ec701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.306539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa57807-e072-43b6-a5f9-e8f1a2ec701b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.315558 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafcfa7-4353-4616-a460-73228fe032eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.316233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafcfa7-4353-4616-a460-73228fe032eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.316716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafcfa7-4353-4616-a460-73228fe032eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.316915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafcfa7-4353-4616-a460-73228fe032eb admin admin] PATH_INFO: `/v3/projects/8e221044b7a44a849b1eaef9c18ae34d/users/cbdfd88ab0f448e48e86379efa48a8dc/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.322089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 637/1269] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.322089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa57807-e072-43b6-a5f9-e8f1a2ec701b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.341298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafcfa7-4353-4616-a460-73228fe032eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e221044b7a44a849b1eaef9c18ae34d, user_id=cbdfd88ab0f448e48e86379efa48a8dc, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.344230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa57807-e072-43b6-a5f9-e8f1a2ec701b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.344358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafcfa7-4353-4616-a460-73228fe032eb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.349165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449707c8-c469-442e-8b7f-cd7244d3e214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.349751 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449707c8-c469-442e-8b7f-cd7244d3e214 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.350190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449707c8-c469-442e-8b7f-cd7244d3e214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.351011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449707c8-c469-442e-8b7f-cd7244d3e214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.351784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449707c8-c469-442e-8b7f-cd7244d3e214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.353559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449707c8-c469-442e-8b7f-cd7244d3e214 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.354672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:50.366264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 633/1270] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:33:50 2022] PUT /identity/v3/projects/8e221044b7a44a849b1eaef9c18ae34d/users/cbdfd88ab0f448e48e86379efa48a8dc/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:50.372156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 638/1271] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.372156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449707c8-c469-442e-8b7f-cd7244d3e214 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.372433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafcfa7-4353-4616-a460-73228fe032eb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.381035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449707c8-c469-442e-8b7f-cd7244d3e214 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.411602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:50.445735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafcfa7-4353-4616-a460-73228fe032eb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.449345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc54156-c3e1-4014-8585-5fa94e4f7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.450014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc54156-c3e1-4014-8585-5fa94e4f7ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.450347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc54156-c3e1-4014-8585-5fa94e4f7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.450571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc54156-c3e1-4014-8585-5fa94e4f7ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.451168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d98258-505f-4bc0-814e-749b29af15e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.451300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc54156-c3e1-4014-8585-5fa94e4f7ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.451953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d98258-505f-4bc0-814e-749b29af15e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.452342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d98258-505f-4bc0-814e-749b29af15e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.452729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d98258-505f-4bc0-814e-749b29af15e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.452887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc54156-c3e1-4014-8585-5fa94e4f7ac0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.453542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d98258-505f-4bc0-814e-749b29af15e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.455213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d98258-505f-4bc0-814e-749b29af15e5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.464727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 639/1272] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.466357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c621d-28be-48d9-bef5-85fb4536e097 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.466847 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c621d-28be-48d9-bef5-85fb4536e097 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.467342 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c621d-28be-48d9-bef5-85fb4536e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.468070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 634/1273] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.469031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d98258-505f-4bc0-814e-749b29af15e5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.484961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d98258-505f-4bc0-814e-749b29af15e5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.491883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9f355-07ec-488c-993d-142ede4338cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.492647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9f355-07ec-488c-993d-142ede4338cc admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.493199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9f355-07ec-488c-993d-142ede4338cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.493584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9f355-07ec-488c-993d-142ede4338cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.494699 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9f355-07ec-488c-993d-142ede4338cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.496741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9f355-07ec-488c-993d-142ede4338cc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.510394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 635/1274] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.511351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9f355-07ec-488c-993d-142ede4338cc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.515242 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-624c621d-28be-48d9-bef5-85fb4536e097 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:50.516553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-624c621d-28be-48d9-bef5-85fb4536e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:50.523058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9f355-07ec-488c-993d-142ede4338cc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.527190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 640/1275] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:50.528527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2412d8-c634-499f-b6ff-9ec1b5b9d89a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.528821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2412d8-c634-499f-b6ff-9ec1b5b9d89a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.529098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2412d8-c634-499f-b6ff-9ec1b5b9d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.531773 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97785c2e-825b-4f3d-ac87-8ce7cdf5c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.532655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97785c2e-825b-4f3d-ac87-8ce7cdf5c98e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.533031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97785c2e-825b-4f3d-ac87-8ce7cdf5c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.533398 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97785c2e-825b-4f3d-ac87-8ce7cdf5c98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.534692 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97785c2e-825b-4f3d-ac87-8ce7cdf5c98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.536227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97785c2e-825b-4f3d-ac87-8ce7cdf5c98e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.550898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 636/1276] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.550898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97785c2e-825b-4f3d-ac87-8ce7cdf5c98e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.559150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6a2412d8-c634-499f-b6ff-9ec1b5b9d89a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:50.560685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6a2412d8-c634-499f-b6ff-9ec1b5b9d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:50.564106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97785c2e-825b-4f3d-ac87-8ce7cdf5c98e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.570289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 641/1277] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:50.571197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2412d8-c634-499f-b6ff-9ec1b5b9d89a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.573846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b90bc-050b-47ff-a241-417491a70471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.574626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b90bc-050b-47ff-a241-417491a70471 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.575006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b90bc-050b-47ff-a241-417491a70471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.575377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b90bc-050b-47ff-a241-417491a70471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.576157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b90bc-050b-47ff-a241-417491a70471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.582644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b90bc-050b-47ff-a241-417491a70471 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.588822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2412d8-c634-499f-b6ff-9ec1b5b9d89a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.595778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 637/1278] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.596568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b90bc-050b-47ff-a241-417491a70471 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.604278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477a9e-34f1-420f-94ef-e2177b404f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.605168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477a9e-34f1-420f-94ef-e2177b404f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.605355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477a9e-34f1-420f-94ef-e2177b404f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.606175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477a9e-34f1-420f-94ef-e2177b404f53 admin admin] PATH_INFO: `/v3/projects/9b7c3a3d71af489ba32a7c0e814f6e65/users/60fbcf6f62f74baf97efac8d024508de/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.612784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b90bc-050b-47ff-a241-417491a70471 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.619294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687aac4-0a39-45e5-a0f9-28cbe747a061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.620030 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687aac4-0a39-45e5-a0f9-28cbe747a061 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.620918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687aac4-0a39-45e5-a0f9-28cbe747a061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.621491 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687aac4-0a39-45e5-a0f9-28cbe747a061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.622032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687aac4-0a39-45e5-a0f9-28cbe747a061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.623720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687aac4-0a39-45e5-a0f9-28cbe747a061 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.624168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477a9e-34f1-420f-94ef-e2177b404f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7c3a3d71af489ba32a7c0e814f6e65, user_id=60fbcf6f62f74baf97efac8d024508de, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.627694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477a9e-34f1-420f-94ef-e2177b404f53 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.635999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 638/1279] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:50.637325 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687aac4-0a39-45e5-a0f9-28cbe747a061 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.643851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 642/1280] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:33:50 2022] PUT /identity/v3/projects/9b7c3a3d71af489ba32a7c0e814f6e65/users/60fbcf6f62f74baf97efac8d024508de/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:50.644889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477a9e-34f1-420f-94ef-e2177b404f53 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.650733 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687aac4-0a39-45e5-a0f9-28cbe747a061 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.720767 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defad8dd-89fa-4675-8f75-283166e0c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.721344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477a9e-34f1-420f-94ef-e2177b404f53 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.721524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defad8dd-89fa-4675-8f75-283166e0c24e admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.721761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defad8dd-89fa-4675-8f75-283166e0c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.722038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defad8dd-89fa-4675-8f75-283166e0c24e admin admin] PATH_INFO: `/v3/projects/aa9d3f9a9c564b89a23064fe52265f59/users/71e75366f8b44eb1a0af9d7f8498c7f5/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.727041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbfca-f03f-45ac-80ca-283d324371a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.727735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbfca-f03f-45ac-80ca-283d324371a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.728084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbfca-f03f-45ac-80ca-283d324371a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.728484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbfca-f03f-45ac-80ca-283d324371a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.739063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcbfca-f03f-45ac-80ca-283d324371a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.740743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcbfca-f03f-45ac-80ca-283d324371a0 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.741708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defad8dd-89fa-4675-8f75-283166e0c24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9d3f9a9c564b89a23064fe52265f59, user_id=71e75366f8b44eb1a0af9d7f8498c7f5, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.744970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defad8dd-89fa-4675-8f75-283166e0c24e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.753298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 643/1281] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:33:50.754460 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbfca-f03f-45ac-80ca-283d324371a0 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.766393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbfca-f03f-45ac-80ca-283d324371a0 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.767724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 639/1282] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:33:50 2022] PUT /identity/v3/projects/aa9d3f9a9c564b89a23064fe52265f59/users/71e75366f8b44eb1a0af9d7f8498c7f5/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:50.769554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defad8dd-89fa-4675-8f75-283166e0c24e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.837911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:50.854886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfdd31-fe0e-4f25-b0fb-0632e953f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.855861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfdd31-fe0e-4f25-b0fb-0632e953f926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.856277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfdd31-fe0e-4f25-b0fb-0632e953f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.856679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfdd31-fe0e-4f25-b0fb-0632e953f926 admin admin] PATH_INFO: `/v3/projects/0f27e83b47b14e39ade5e433aa67ee06/users/e5a74c677cfc479290dae484dc34df26/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.859573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defad8dd-89fa-4675-8f75-283166e0c24e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.864433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e209b1-a141-4e16-9047-09f5c5dd5886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.865114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e209b1-a141-4e16-9047-09f5c5dd5886 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.865467 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e209b1-a141-4e16-9047-09f5c5dd5886 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.866401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e209b1-a141-4e16-9047-09f5c5dd5886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:50.877900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e209b1-a141-4e16-9047-09f5c5dd5886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.879567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e209b1-a141-4e16-9047-09f5c5dd5886 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.880860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfdd31-fe0e-4f25-b0fb-0632e953f926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f27e83b47b14e39ade5e433aa67ee06, user_id=e5a74c677cfc479290dae484dc34df26, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:50.884996 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfdd31-fe0e-4f25-b0fb-0632e953f926 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:50.890583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 640/1283] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:33:50.891567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e209b1-a141-4e16-9047-09f5c5dd5886 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.902601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e209b1-a141-4e16-9047-09f5c5dd5886 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:50.903926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 644/1284] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:33:50 2022] PUT /identity/v3/projects/0f27e83b47b14e39ade5e433aa67ee06/users/e5a74c677cfc479290dae484dc34df26/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:50.905210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfdd31-fe0e-4f25-b0fb-0632e953f926 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:50.924500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:50.983792 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232da2ba-aa1f-476a-99f4-4ed71d89c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:50.985110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232da2ba-aa1f-476a-99f4-4ed71d89c722 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:50.985456 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232da2ba-aa1f-476a-99f4-4ed71d89c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:50.986012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232da2ba-aa1f-476a-99f4-4ed71d89c722 admin admin] PATH_INFO: `/v3/projects/afed770d53444520ae229deacfd61f26/users/1b272bebbecb41939e37640b19038973/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.004212 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfdd31-fe0e-4f25-b0fb-0632e953f926 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:51.007859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232da2ba-aa1f-476a-99f4-4ed71d89c722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afed770d53444520ae229deacfd61f26, user_id=1b272bebbecb41939e37640b19038973, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:51.010834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232da2ba-aa1f-476a-99f4-4ed71d89c722 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:51.011638 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03e314-9227-4caf-a79e-fa73c9c06906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:51.012200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03e314-9227-4caf-a79e-fa73c9c06906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.012791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03e314-9227-4caf-a79e-fa73c9c06906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.012950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03e314-9227-4caf-a79e-fa73c9c06906 admin admin] PATH_INFO: `/v3/projects/6d203394b8aa4b5aaed0f15cfa2664f0/users/78ca6fbbda31433bbe598ce667103cae/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.038907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 641/1285] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:33:50 2022] PUT /identity/v3/projects/afed770d53444520ae229deacfd61f26/users/1b272bebbecb41939e37640b19038973/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:51.038907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8ae22-56d1-42cd-985f-e86d53df963d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.039276 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8ae22-56d1-42cd-985f-e86d53df963d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.040074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8ae22-56d1-42cd-985f-e86d53df963d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.047406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03e314-9227-4caf-a79e-fa73c9c06906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d203394b8aa4b5aaed0f15cfa2664f0, user_id=78ca6fbbda31433bbe598ce667103cae, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:51.050199 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03e314-9227-4caf-a79e-fa73c9c06906 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:51.072149 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 645/1286] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:33:50 2022] PUT /identity/v3/projects/6d203394b8aa4b5aaed0f15cfa2664f0/users/78ca6fbbda31433bbe598ce667103cae/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:51.074271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0bcc-e88b-4402-9e66-4978fbad5e58 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.074629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0bcc-e88b-4402-9e66-4978fbad5e58 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.075028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0bcc-e88b-4402-9e66-4978fbad5e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.102758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cfdf0bcc-e88b-4402-9e66-4978fbad5e58 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:51.104411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cfdf0bcc-e88b-4402-9e66-4978fbad5e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:51.128876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-17a8ae22-56d1-42cd-985f-e86d53df963d None None] MFA Rules not processed for user `60fbcf6f62f74baf97efac8d024508de`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:51.130525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-17a8ae22-56d1-42cd-985f-e86d53df963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:51.203020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 646/1287] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:51.206512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80cc04-8990-415b-8e7a-b647ff6d331a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.206512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80cc04-8990-415b-8e7a-b647ff6d331a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.206512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80cc04-8990-415b-8e7a-b647ff6d331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.259873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 642/1288] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:51.264055 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072a26c-7b13-4d39-8fb5-b5bcc8279ee5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.265037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7d80cc04-8990-415b-8e7a-b647ff6d331a None None] MFA Rules not processed for user `e5a74c677cfc479290dae484dc34df26`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:51.265464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072a26c-7b13-4d39-8fb5-b5bcc8279ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.266114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072a26c-7b13-4d39-8fb5-b5bcc8279ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.267057 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7d80cc04-8990-415b-8e7a-b647ff6d331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:51.317447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7072a26c-7b13-4d39-8fb5-b5bcc8279ee5 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:51.320782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7072a26c-7b13-4d39-8fb5-b5bcc8279ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:51.344430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 643/1289] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:51.346142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22a5c7-29e5-4c5b-a8ea-f84b980754a5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.347633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22a5c7-29e5-4c5b-a8ea-f84b980754a5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.348137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22a5c7-29e5-4c5b-a8ea-f84b980754a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.385464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7a22a5c7-29e5-4c5b-a8ea-f84b980754a5 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:51.387407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a22a5c7-29e5-4c5b-a8ea-f84b980754a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:51.390015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 647/1290] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:51.390974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80cc04-8990-415b-8e7a-b647ff6d331a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:51.406900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 644/1291] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:51.409043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22a5c7-29e5-4c5b-a8ea-f84b980754a5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:51.411840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a22a5c7-29e5-4c5b-a8ea-f84b980754a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:51.451126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:51.517556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80cc04-8990-415b-8e7a-b647ff6d331a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:51.523980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:51.524397 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b306c-9ced-466c-9a43-35a34681994c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:51.524841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b306c-9ced-466c-9a43-35a34681994c service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.524989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b306c-9ced-466c-9a43-35a34681994c service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.525364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b306c-9ced-466c-9a43-35a34681994c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.538818 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b306c-9ced-466c-9a43-35a34681994c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:51.541055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b306c-9ced-466c-9a43-35a34681994c service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:51.556203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 648/1292] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:33:51.557181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b306c-9ced-466c-9a43-35a34681994c service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:51.568221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b306c-9ced-466c-9a43-35a34681994c service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:51.573887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3a20-a397-455c-940a-5bb41a5c7e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:51.574939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3a20-a397-455c-940a-5bb41a5c7e2b service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.575382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3a20-a397-455c-940a-5bb41a5c7e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.575928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3a20-a397-455c-940a-5bb41a5c7e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.591425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e3a20-a397-455c-940a-5bb41a5c7e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:51.594160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e3a20-a397-455c-940a-5bb41a5c7e2b service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:51.600880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22a5c7-29e5-4c5b-a8ea-f84b980754a5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:51.607768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 649/1293] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:33:51.608913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3a20-a397-455c-940a-5bb41a5c7e2b service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:51.619295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3a20-a397-455c-940a-5bb41a5c7e2b service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:51.620383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d7df3-a12d-4c40-a551-75705616c8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:51.621064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7df3-a12d-4c40-a551-75705616c8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.621347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7df3-a12d-4c40-a551-75705616c8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.621619 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7df3-a12d-4c40-a551-75705616c8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.626206 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e611c-516e-4148-8727-d5d7b6574181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:51.626797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e611c-516e-4148-8727-d5d7b6574181 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.627127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e611c-516e-4148-8727-d5d7b6574181 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.627405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e611c-516e-4148-8727-d5d7b6574181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.643985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d7df3-a12d-4c40-a551-75705616c8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:51.647525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d7df3-a12d-4c40-a551-75705616c8c3 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:51.648987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e611c-516e-4148-8727-d5d7b6574181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:51.653038 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e611c-516e-4148-8727-d5d7b6574181 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:51.676033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 645/1294] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:33:51.678000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 650/1295] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:33:51.678787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace54faf-7841-4154-a6dc-0db497fc510f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.679231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace54faf-7841-4154-a6dc-0db497fc510f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.679617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace54faf-7841-4154-a6dc-0db497fc510f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.690051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480c94-c866-4c51-84bc-a8ba0a4ef578 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.690051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480c94-c866-4c51-84bc-a8ba0a4ef578 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.690362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480c94-c866-4c51-84bc-a8ba0a4ef578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.691249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 646/1296] 10.222.0.20 () {54 vars in 961 bytes} [Wed Nov 2 03:33:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:33:51.753683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3f480c94-c866-4c51-84bc-a8ba0a4ef578 None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:51.755337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3f480c94-c866-4c51-84bc-a8ba0a4ef578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:51.903738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace54faf-7841-4154-a6dc-0db497fc510f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:51.909328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 651/1297] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Nov 2 03:33:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:51.940748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace54faf-7841-4154-a6dc-0db497fc510f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:51.949917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8004a7-b070-4626-8b14-42ca1164964f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:51.950616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8004a7-b070-4626-8b14-42ca1164964f service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:51.950989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8004a7-b070-4626-8b14-42ca1164964f service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:51.951281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8004a7-b070-4626-8b14-42ca1164964f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:51.967440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8004a7-b070-4626-8b14-42ca1164964f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:51.975529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8004a7-b070-4626-8b14-42ca1164964f service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:52.013039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 647/1298] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:33:52.578573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829752b8-a9d3-4fd5-9dc2-6a49b4899037 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:52.579347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829752b8-a9d3-4fd5-9dc2-6a49b4899037 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:52.579347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829752b8-a9d3-4fd5-9dc2-6a49b4899037 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:52.580822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 652/1299] 10.222.0.20 () {54 vars in 912 bytes} [Wed Nov 2 03:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:33:52.589626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18645c-4034-4737-bb3a-daea20a36db4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:52.590189 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18645c-4034-4737-bb3a-daea20a36db4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:52.590275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18645c-4034-4737-bb3a-daea20a36db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:52.627388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3d18645c-4034-4737-bb3a-daea20a36db4 None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:52.629264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3d18645c-4034-4737-bb3a-daea20a36db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:52.650326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 648/1300] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:33:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:52.658307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829752b8-a9d3-4fd5-9dc2-6a49b4899037 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:52.671455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829752b8-a9d3-4fd5-9dc2-6a49b4899037 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:52.677894 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10497a1-4612-46b7-9ff6-122c97631be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:52.680250 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10497a1-4612-46b7-9ff6-122c97631be2 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:52.680572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10497a1-4612-46b7-9ff6-122c97631be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:52.682187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10497a1-4612-46b7-9ff6-122c97631be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:52.699282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10497a1-4612-46b7-9ff6-122c97631be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:52.701130 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10497a1-4612-46b7-9ff6-122c97631be2 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:52.720511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 653/1301] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:33:53.244276 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b5720-ea99-4df0-add3-19a12bc1e9bb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:53.244276 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b5720-ea99-4df0-add3-19a12bc1e9bb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:53.244276 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b5720-ea99-4df0-add3-19a12bc1e9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:53.329041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bb5b5720-ea99-4df0-add3-19a12bc1e9bb None None] MFA Rules not processed for user `1b272bebbecb41939e37640b19038973`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:53.332883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bb5b5720-ea99-4df0-add3-19a12bc1e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:53.532012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10497a1-4612-46b7-9ff6-122c97631be2 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:53.532714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 649/1302] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:53.550255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10497a1-4612-46b7-9ff6-122c97631be2 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:53.562744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4a254-4ad9-4fd7-8912-86d9cb8258a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:53.563379 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4a254-4ad9-4fd7-8912-86d9cb8258a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:53.563658 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4a254-4ad9-4fd7-8912-86d9cb8258a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:53.563929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4a254-4ad9-4fd7-8912-86d9cb8258a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:53.564598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4a254-4ad9-4fd7-8912-86d9cb8258a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:53.566509 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4a254-4ad9-4fd7-8912-86d9cb8258a2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:53.623133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 654/1303] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:33:53 2022] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:53.629450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b5720-ea99-4df0-add3-19a12bc1e9bb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:53.647700 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b5720-ea99-4df0-add3-19a12bc1e9bb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:53.844860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8c11-efcb-408f-8262-61bf54c82b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:53.845580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8c11-efcb-408f-8262-61bf54c82b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:53.849402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8c11-efcb-408f-8262-61bf54c82b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:53.850419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8c11-efcb-408f-8262-61bf54c82b2b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:53.851474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8c11-efcb-408f-8262-61bf54c82b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:53.858510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8c11-efcb-408f-8262-61bf54c82b2b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:53.914115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 650/1304] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:33:53 2022] POST /identity/v3/users => generated 309 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:33:53.914907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4a254-4ad9-4fd7-8912-86d9cb8258a2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:53.929721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4a254-4ad9-4fd7-8912-86d9cb8258a2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:53.941128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d778cd8-e2a8-49fa-bac4-c2d421103fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:53.941840 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d778cd8-e2a8-49fa-bac4-c2d421103fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:53.942190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d778cd8-e2a8-49fa-bac4-c2d421103fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:53.942689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d778cd8-e2a8-49fa-bac4-c2d421103fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:53.943601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d778cd8-e2a8-49fa-bac4-c2d421103fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:53.946426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d778cd8-e2a8-49fa-bac4-c2d421103fd2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:53.971858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 655/1305] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:53.977040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8c11-efcb-408f-8262-61bf54c82b2b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:53.992584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8c11-efcb-408f-8262-61bf54c82b2b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:54.007788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa62d94-f139-4b80-aeea-90bf22032bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:54.008552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa62d94-f139-4b80-aeea-90bf22032bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:54.008841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa62d94-f139-4b80-aeea-90bf22032bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:54.009143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa62d94-f139-4b80-aeea-90bf22032bf0 admin admin] PATH_INFO: `/v3/projects/8aa139f1cea14f4787ab923d41218c75/users/e62db526d1e44b38acbd1d3432649456/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:54.021852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e386c-2cfe-46c6-9e36-0aa0f8d88bf6 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:54.022514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e386c-2cfe-46c6-9e36-0aa0f8d88bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:54.023245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e386c-2cfe-46c6-9e36-0aa0f8d88bf6 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:54.025236 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 656/1306] 10.222.0.20 () {54 vars in 961 bytes} [Wed Nov 2 03:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:33:54.054480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa62d94-f139-4b80-aeea-90bf22032bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa139f1cea14f4787ab923d41218c75, user_id=e62db526d1e44b38acbd1d3432649456, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:54.060652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa62d94-f139-4b80-aeea-90bf22032bf0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:54.078139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bf4f5-ebff-4598-a96d-472331759c6a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:54.078761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bf4f5-ebff-4598-a96d-472331759c6a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:54.079316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bf4f5-ebff-4598-a96d-472331759c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:54.110992 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 651/1307] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:33:53 2022] PUT /identity/v3/projects/8aa139f1cea14f4787ab923d41218c75/users/e62db526d1e44b38acbd1d3432649456/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:54.112182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0d1bf4f5-ebff-4598-a96d-472331759c6a None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:54.116617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa62d94-f139-4b80-aeea-90bf22032bf0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:54.116997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0d1bf4f5-ebff-4598-a96d-472331759c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:54.155031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:54.183330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:54.267239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 657/1308] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Nov 2 03:33:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:33:54.276594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91203401-7fa7-46c0-85ef-ab2149f9858c None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:54.277277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91203401-7fa7-46c0-85ef-ab2149f9858c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:54.277765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91203401-7fa7-46c0-85ef-ab2149f9858c None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:54.278448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa62d94-f139-4b80-aeea-90bf22032bf0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:54.282834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 658/1309] 10.222.0.20 () {54 vars in 912 bytes} [Wed Nov 2 03:33:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:33:54.289602 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67cee0-4497-432e-8079-8a10d265b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:54.290879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d331b5f-3608-4cf4-b921-ccd0d78474a9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:54.291010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67cee0-4497-432e-8079-8a10d265b6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:54.291293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67cee0-4497-432e-8079-8a10d265b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:54.291796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d331b5f-3608-4cf4-b921-ccd0d78474a9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:54.292383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d331b5f-3608-4cf4-b921-ccd0d78474a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:54.292596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67cee0-4497-432e-8079-8a10d265b6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:54.293251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67cee0-4497-432e-8079-8a10d265b6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:54.295850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67cee0-4497-432e-8079-8a10d265b6d0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:54.325746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 652/1310] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:33:54.331118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67cee0-4497-432e-8079-8a10d265b6d0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:54.332600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8d331b5f-3608-4cf4-b921-ccd0d78474a9 None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:54.334164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8d331b5f-3608-4cf4-b921-ccd0d78474a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:54.354320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67cee0-4497-432e-8079-8a10d265b6d0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:54.371994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec2af1-9d93-4f14-b397-10f981c37356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:54.372744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec2af1-9d93-4f14-b397-10f981c37356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:54.373035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec2af1-9d93-4f14-b397-10f981c37356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:54.373315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec2af1-9d93-4f14-b397-10f981c37356 admin admin] PATH_INFO: `/v3/projects/8aa139f1cea14f4787ab923d41218c75/users/e62db526d1e44b38acbd1d3432649456/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:54.382667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec2af1-9d93-4f14-b397-10f981c37356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa139f1cea14f4787ab923d41218c75, user_id=e62db526d1e44b38acbd1d3432649456, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:54.384031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 659/1311] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:33:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:33:54.385472 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec2af1-9d93-4f14-b397-10f981c37356 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:54.399803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d331b5f-3608-4cf4-b921-ccd0d78474a9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:54.421882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 653/1312] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:33:54 2022] PUT /identity/v3/projects/8aa139f1cea14f4787ab923d41218c75/users/e62db526d1e44b38acbd1d3432649456/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:54.511399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d331b5f-3608-4cf4-b921-ccd0d78474a9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:54.639219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e195bb-3d06-458c-beda-8be5175e76ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:54.640099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e195bb-3d06-458c-beda-8be5175e76ad service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:54.640232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e195bb-3d06-458c-beda-8be5175e76ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:54.640732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e195bb-3d06-458c-beda-8be5175e76ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:54.797327 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e195bb-3d06-458c-beda-8be5175e76ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:54.799541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e195bb-3d06-458c-beda-8be5175e76ad service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:54.825980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 660/1313] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:33:57.258108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9f0e-2f12-43d4-a802-0b4e6ba11d68 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:57.258640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9f0e-2f12-43d4-a802-0b4e6ba11d68 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:57.258640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9f0e-2f12-43d4-a802-0b4e6ba11d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:57.372343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-06fc9f0e-2f12-43d4-a802-0b4e6ba11d68 None None] MFA Rules not processed for user `e62db526d1e44b38acbd1d3432649456`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:57.376046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-06fc9f0e-2f12-43d4-a802-0b4e6ba11d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:57.721078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 654/1314] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:57 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:33:58.920362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e195bb-3d06-458c-beda-8be5175e76ad service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:58.953143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:33:59.006683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e195bb-3d06-458c-beda-8be5175e76ad service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:59.030337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:59.031277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:59.031719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:59.032155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] PATH_INFO: `/v3/users/e5a74c677cfc479290dae484dc34df26` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:59.033558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a74c677cfc479290dae484dc34df26)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:59.035708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:59.136108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a74c677cfc479290dae484dc34df26'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:33:59.140293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a74c677cfc479290dae484dc34df26'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:33:59.151442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a74c677cfc479290dae484dc34df26'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:33:59.152588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a74c677cfc479290dae484dc34df26'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:33:59.170059 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a74c677cfc479290dae484dc34df26'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:33:59.193181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 661/1315] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:33:58 2022] DELETE /identity/v3/users/e5a74c677cfc479290dae484dc34df26 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:33:59.195503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34abe0-bb84-4f01-848d-606026c9b03f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:59.196398 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34abe0-bb84-4f01-848d-606026c9b03f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:59.197006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34abe0-bb84-4f01-848d-606026c9b03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:59.241548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dc34abe0-bb84-4f01-848d-606026c9b03f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:33:59.245756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dc34abe0-bb84-4f01-848d-606026c9b03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:59.427386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 655/1316] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:33:59.461844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:33:59.465843 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:33:59.581737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a53a4-da12-4448-a8f9-633012f8bf8c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:33:59.587309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a8035-b420-4808-8af5-9d731ad25411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:33:59.587309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a8035-b420-4808-8af5-9d731ad25411 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:33:59.587596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a8035-b420-4808-8af5-9d731ad25411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:33:59.587941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a8035-b420-4808-8af5-9d731ad25411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:33:59.600685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a8035-b420-4808-8af5-9d731ad25411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:33:59.603387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a8035-b420-4808-8af5-9d731ad25411 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:33:59.627469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 662/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:02.410327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b132c7f-ce95-4cbc-90ed-1dbbc1d5c6ce None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:02.411909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b132c7f-ce95-4cbc-90ed-1dbbc1d5c6ce None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:02.412567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b132c7f-ce95-4cbc-90ed-1dbbc1d5c6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:02.465604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9b132c7f-ce95-4cbc-90ed-1dbbc1d5c6ce None None] MFA Rules not processed for user `962b2af5884f493bb3ea707735fdb431`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:02.471987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9b132c7f-ce95-4cbc-90ed-1dbbc1d5c6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:02.491592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:02.629739 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 656/1318] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:02.641240 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2d8c5-ffb6-462f-843f-c237bbe026f2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:02.641240 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2d8c5-ffb6-462f-843f-c237bbe026f2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:02.641760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2d8c5-ffb6-462f-843f-c237bbe026f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:02.675719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-36e2d8c5-ffb6-462f-843f-c237bbe026f2 None None] MFA Rules not processed for user `962b2af5884f493bb3ea707735fdb431`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:02.677175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-36e2d8c5-ffb6-462f-843f-c237bbe026f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:02.686073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 663/1319] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:02.708204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b132c7f-ce95-4cbc-90ed-1dbbc1d5c6ce None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:02.709400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9b132c7f-ce95-4cbc-90ed-1dbbc1d5c6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:02.837735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b132c7f-ce95-4cbc-90ed-1dbbc1d5c6ce None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:02.845349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a99455-e694-4b45-a80c-a5486bc531ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:02.846000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99455-e694-4b45-a80c-a5486bc531ec service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:02.846313 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99455-e694-4b45-a80c-a5486bc531ec service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:02.846580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99455-e694-4b45-a80c-a5486bc531ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:02.869459 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a99455-e694-4b45-a80c-a5486bc531ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:02.871245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a99455-e694-4b45-a80c-a5486bc531ec service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:02.888641 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 657/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:03.441042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2d8c5-ffb6-462f-843f-c237bbe026f2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:03.441042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-36e2d8c5-ffb6-462f-843f-c237bbe026f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:03.469531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2d8c5-ffb6-462f-843f-c237bbe026f2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:03.483122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:03.483999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:03.484347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:03.484776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] PATH_INFO: `/v3/users/60fbcf6f62f74baf97efac8d024508de` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:03.486342 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fbcf6f62f74baf97efac8d024508de)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:03.491633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:03.499259 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3d92d-a0da-4165-b3ff-e0b200ef2e90 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:03.499835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3d92d-a0da-4165-b3ff-e0b200ef2e90 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:03.499835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3d92d-a0da-4165-b3ff-e0b200ef2e90 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:03.502204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 658/1321] 10.222.0.20 () {54 vars in 912 bytes} [Wed Nov 2 03:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:34:03.508971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa12dc1-b6d0-4625-8880-16f15850637f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:03.509976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa12dc1-b6d0-4625-8880-16f15850637f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:03.510409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa12dc1-b6d0-4625-8880-16f15850637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:03.539052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:03.569444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dfa12dc1-b6d0-4625-8880-16f15850637f None None] MFA Rules not processed for user `aea5fababc0a497686549ed7b9b85c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:03.570970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dfa12dc1-b6d0-4625-8880-16f15850637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:03.573314 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fbcf6f62f74baf97efac8d024508de'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:03.575118 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fbcf6f62f74baf97efac8d024508de'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:03.585231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 659/1322] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:34:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:03.589025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fbcf6f62f74baf97efac8d024508de'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:03.589884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fbcf6f62f74baf97efac8d024508de'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:03.596628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa12dc1-b6d0-4625-8880-16f15850637f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:03.598382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dfa12dc1-b6d0-4625-8880-16f15850637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:03.613959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa12dc1-b6d0-4625-8880-16f15850637f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:03.618656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e040eae-6381-45dd-bce4-6f89a907a2f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fbcf6f62f74baf97efac8d024508de'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:03.623129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a521c92-9679-47ee-bbc4-f4e722135a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:03.624292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a521c92-9679-47ee-bbc4-f4e722135a96 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:03.624751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a521c92-9679-47ee-bbc4-f4e722135a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:03.625237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a521c92-9679-47ee-bbc4-f4e722135a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:03.646613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a521c92-9679-47ee-bbc4-f4e722135a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:03.649007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a521c92-9679-47ee-bbc4-f4e722135a96 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:03.653899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 664/1323] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:03 2022] DELETE /identity/v3/users/60fbcf6f62f74baf97efac8d024508de => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:03.655727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5705c1-dee3-4d38-8ac5-dc86f5252d82 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:03.656901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5705c1-dee3-4d38-8ac5-dc86f5252d82 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:03.658796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5705c1-dee3-4d38-8ac5-dc86f5252d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:03.683446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 660/1324] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:03.684951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a198456-58da-427d-8d53-65df4241dc0e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:03.685244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a198456-58da-427d-8d53-65df4241dc0e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:03.685529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a198456-58da-427d-8d53-65df4241dc0e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:03.697678 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 661/1325] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:34:03 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:34:03.698983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a198456-58da-427d-8d53-65df4241dc0e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:03.704496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ad5705c1-dee3-4d38-8ac5-dc86f5252d82 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:03.704694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9a198456-58da-427d-8d53-65df4241dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:03.709650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ad5705c1-dee3-4d38-8ac5-dc86f5252d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:03.827505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 665/1326] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:03.835992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cee828-0df8-477a-b546-af21b4aff306 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:03.836301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cee828-0df8-477a-b546-af21b4aff306 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:03.836585 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cee828-0df8-477a-b546-af21b4aff306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:03.842106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a198456-58da-427d-8d53-65df4241dc0e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:03.848939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:03.850599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:03.851714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:03.852423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] PATH_INFO: `/v3/projects/0f27e83b47b14e39ade5e433aa67ee06` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:03.855104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f27e83b47b14e39ade5e433aa67ee06)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:03.857364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:03.870222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:03.899222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-47cee828-0df8-477a-b546-af21b4aff306 None None] MFA Rules not processed for user `91b2777a51af45f5a86627d840f5b814`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:03.901517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-47cee828-0df8-477a-b546-af21b4aff306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:03.967739 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f27e83b47b14e39ade5e433aa67ee06', 'request_id': 'req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:03.983523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f27e83b47b14e39ade5e433aa67ee06', 'request_id': 'req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:04.011130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f27e83b47b14e39ade5e433aa67ee06', 'request_id': 'req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:04.043032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] The token cache is being invalidate because project 0f27e83b47b14e39ade5e433aa67ee06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:04.043332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:04.044685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:04.046628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 662/1327] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:03 2022] DELETE /identity/v3/projects/0f27e83b47b14e39ade5e433aa67ee06 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:04.047142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:04.058741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:04.081174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 666/1328] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:34:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:04.082398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909e1cd-ec10-4c7d-bcfc-ad48a5a98411 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.082688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909e1cd-ec10-4c7d-bcfc-ad48a5a98411 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.082962 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909e1cd-ec10-4c7d-bcfc-ad48a5a98411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.125031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e909e1cd-ec10-4c7d-bcfc-ad48a5a98411 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:04.126244 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e909e1cd-ec10-4c7d-bcfc-ad48a5a98411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:04.185495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f7ee-2a58-4d02-a305-210b3c5d1ec5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:04.193930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bed9df-49a0-45a7-b377-b146ad2add38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:04.199092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bed9df-49a0-45a7-b377-b146ad2add38 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.202891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bed9df-49a0-45a7-b377-b146ad2add38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.203452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bed9df-49a0-45a7-b377-b146ad2add38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.207164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-74bed9df-49a0-45a7-b377-b146ad2add38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:04.241522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:04.308325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 667/1329] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:04.317808 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb6372-cd58-4301-975f-9a5d858fd1b1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.318986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb6372-cd58-4301-975f-9a5d858fd1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.319413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb6372-cd58-4301-975f-9a5d858fd1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.368290 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d3bb6372-cd58-4301-975f-9a5d858fd1b1 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:04.373268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d3bb6372-cd58-4301-975f-9a5d858fd1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:04.391691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bed9df-49a0-45a7-b377-b146ad2add38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:04.393359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bed9df-49a0-45a7-b377-b146ad2add38 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:04.398311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 668/1330] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:04.399369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb6372-cd58-4301-975f-9a5d858fd1b1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:04.411335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d3bb6372-cd58-4301-975f-9a5d858fd1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:04.423499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 663/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:04.425353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bed9df-49a0-45a7-b377-b146ad2add38 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:04.448616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bed9df-49a0-45a7-b377-b146ad2add38 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:04.461032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea657a-8b7a-40a1-854f-1554adab8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:04.462684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea657a-8b7a-40a1-854f-1554adab8dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.463656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea657a-8b7a-40a1-854f-1554adab8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.464963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea657a-8b7a-40a1-854f-1554adab8dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.465774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea657a-8b7a-40a1-854f-1554adab8dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:04.467244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea657a-8b7a-40a1-854f-1554adab8dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:04.469755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea657a-8b7a-40a1-854f-1554adab8dcb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:04.506800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 664/1332] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:04.509168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea657a-8b7a-40a1-854f-1554adab8dcb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:04.531946 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea657a-8b7a-40a1-854f-1554adab8dcb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:04.540805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781e344-dcbc-46a1-b124-07ea5a4e126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:04.542783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781e344-dcbc-46a1-b124-07ea5a4e126a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.543173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781e344-dcbc-46a1-b124-07ea5a4e126a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.543842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781e344-dcbc-46a1-b124-07ea5a4e126a admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.545719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781e344-dcbc-46a1-b124-07ea5a4e126a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:04.550750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781e344-dcbc-46a1-b124-07ea5a4e126a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:04.602708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb6372-cd58-4301-975f-9a5d858fd1b1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:04.619880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 665/1333] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:04 2022] POST /identity/v3/projects => generated 399 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:04.621360 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781e344-dcbc-46a1-b124-07ea5a4e126a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:04.633572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a9e66-a899-45bf-a08e-3ba242bde7f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:04.641409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:04.642221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a9e66-a899-45bf-a08e-3ba242bde7f4 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.642646 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a9e66-a899-45bf-a08e-3ba242bde7f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.643016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a9e66-a899-45bf-a08e-3ba242bde7f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.697011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a9e66-a899-45bf-a08e-3ba242bde7f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:04.699879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a9e66-a899-45bf-a08e-3ba242bde7f4 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:04.738315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781e344-dcbc-46a1-b124-07ea5a4e126a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:04.744806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bec84e-1758-4cc7-93a1-9934c9460db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:04.745817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bec84e-1758-4cc7-93a1-9934c9460db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.746208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bec84e-1758-4cc7-93a1-9934c9460db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.747223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bec84e-1758-4cc7-93a1-9934c9460db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.747403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bec84e-1758-4cc7-93a1-9934c9460db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:04.750836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bec84e-1758-4cc7-93a1-9934c9460db6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:04.777452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 669/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:04.784691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 666/1335] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:04 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:04.788901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a9e66-a899-45bf-a08e-3ba242bde7f4 service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:04.804036 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a9e66-a899-45bf-a08e-3ba242bde7f4 service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:04.828348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf090-66e5-4ba5-a290-8c40645a9849 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.828794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf090-66e5-4ba5-a290-8c40645a9849 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.829266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf090-66e5-4ba5-a290-8c40645a9849 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.831929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 667/1336] 10.222.0.20 () {54 vars in 961 bytes} [Wed Nov 2 03:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:34:04.841227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54804f64-3b22-41aa-8069-55a25a9e48d9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.842530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54804f64-3b22-41aa-8069-55a25a9e48d9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.842957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54804f64-3b22-41aa-8069-55a25a9e48d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.851964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4d242-8e8b-4e82-84d6-e4471b8bb604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:04.852676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4d242-8e8b-4e82-84d6-e4471b8bb604 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.853018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4d242-8e8b-4e82-84d6-e4471b8bb604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.853295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4d242-8e8b-4e82-84d6-e4471b8bb604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.860622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4d242-8e8b-4e82-84d6-e4471b8bb604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:04.866970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4d242-8e8b-4e82-84d6-e4471b8bb604 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:04.871892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-54804f64-3b22-41aa-8069-55a25a9e48d9 None None] MFA Rules not processed for user `91b2777a51af45f5a86627d840f5b814`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:04.873615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-54804f64-3b22-41aa-8069-55a25a9e48d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:04.897032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 670/1337] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:04.899792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4d242-8e8b-4e82-84d6-e4471b8bb604 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:04.926205 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4d242-8e8b-4e82-84d6-e4471b8bb604 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:04.935630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513acb4-af69-4d40-b7cb-cb1c6ff7cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:04.936261 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513acb4-af69-4d40-b7cb-cb1c6ff7cf11 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:04.939622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513acb4-af69-4d40-b7cb-cb1c6ff7cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:04.940574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513acb4-af69-4d40-b7cb-cb1c6ff7cf11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:04.941318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513acb4-af69-4d40-b7cb-cb1c6ff7cf11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:04.944437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513acb4-af69-4d40-b7cb-cb1c6ff7cf11 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:04.976782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 671/1338] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:04.982562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513acb4-af69-4d40-b7cb-cb1c6ff7cf11 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:05.001248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513acb4-af69-4d40-b7cb-cb1c6ff7cf11 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:05.010757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb636d-d16d-4b51-8ff4-f77254fe0d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:05.011587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb636d-d16d-4b51-8ff4-f77254fe0d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:05.011870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb636d-d16d-4b51-8ff4-f77254fe0d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:05.012144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb636d-d16d-4b51-8ff4-f77254fe0d82 admin admin] PATH_INFO: `/v3/projects/91a84e6871924615aec2aa95641312ce/users/6e6a3aded04f4b62863c9cf0061de5b4/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:05.017883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 668/1339] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Nov 2 03:34:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:05.018956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54804f64-3b22-41aa-8069-55a25a9e48d9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:05.030607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54804f64-3b22-41aa-8069-55a25a9e48d9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:05.044053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb636d-d16d-4b51-8ff4-f77254fe0d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a84e6871924615aec2aa95641312ce, user_id=6e6a3aded04f4b62863c9cf0061de5b4, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:05.048131 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb636d-d16d-4b51-8ff4-f77254fe0d82 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:05.058635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523f58-924b-4cfc-9067-d889ddd90fe8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:05.059506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523f58-924b-4cfc-9067-d889ddd90fe8 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:05.059896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523f58-924b-4cfc-9067-d889ddd90fe8 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:05.060281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523f58-924b-4cfc-9067-d889ddd90fe8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:05.063128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-80523f58-924b-4cfc-9067-d889ddd90fe8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:05.083240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80523f58-924b-4cfc-9067-d889ddd90fe8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:05.086129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80523f58-924b-4cfc-9067-d889ddd90fe8 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:05.109871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 672/1340] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:04 2022] PUT /identity/v3/projects/91a84e6871924615aec2aa95641312ce/users/6e6a3aded04f4b62863c9cf0061de5b4/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:05.121735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40dc10-1096-48ce-93e3-0678fdfe0c39 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:05.122910 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40dc10-1096-48ce-93e3-0678fdfe0c39 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:05.123306 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40dc10-1096-48ce-93e3-0678fdfe0c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:05.128241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 669/1341] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:05.196047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0a40dc10-1096-48ce-93e3-0678fdfe0c39 None None] MFA Rules not processed for user `6e6a3aded04f4b62863c9cf0061de5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:05.197612 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0a40dc10-1096-48ce-93e3-0678fdfe0c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:05.389148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 673/1342] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:05.392971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523f58-924b-4cfc-9067-d889ddd90fe8 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:05.413490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523f58-924b-4cfc-9067-d889ddd90fe8 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:05.602164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5b197-e9d9-4f12-bab7-5ebe901570f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:05.604925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5b197-e9d9-4f12-bab7-5ebe901570f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:05.605431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5b197-e9d9-4f12-bab7-5ebe901570f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:05.606082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5b197-e9d9-4f12-bab7-5ebe901570f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:05.607199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5b197-e9d9-4f12-bab7-5ebe901570f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:05.609492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5b197-e9d9-4f12-bab7-5ebe901570f5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:05.680751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 670/1343] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:05 2022] POST /identity/v3/projects => generated 401 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:05.682169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40dc10-1096-48ce-93e3-0678fdfe0c39 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:05.684395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0a40dc10-1096-48ce-93e3-0678fdfe0c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:05.685662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5b197-e9d9-4f12-bab7-5ebe901570f5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:05.708262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:05.719907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40dc10-1096-48ce-93e3-0678fdfe0c39 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:05.733057 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:05.822798 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5b197-e9d9-4f12-bab7-5ebe901570f5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:05.834684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333d4ee-2e0e-4715-a133-4f06bf94e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:05.835922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333d4ee-2e0e-4715-a133-4f06bf94e156 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:05.836181 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333d4ee-2e0e-4715-a133-4f06bf94e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:05.836499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333d4ee-2e0e-4715-a133-4f06bf94e156 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:05.838208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333d4ee-2e0e-4715-a133-4f06bf94e156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:05.843037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333d4ee-2e0e-4715-a133-4f06bf94e156 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:05.873330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:05.873919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:05.874176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:05.874451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] PATH_INFO: `/v3/projects/9b7c3a3d71af489ba32a7c0e814f6e65` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:05.877262 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7c3a3d71af489ba32a7c0e814f6e65)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:05.879732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: WARNING py.warnings [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:34:05.879732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: warnings.warn(msg) Nov 02 03:34:05.879732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: Nov 02 03:34:05.883337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:05.901457 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 671/1344] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:05 2022] POST /identity/v3/users => generated 307 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:05.905545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333d4ee-2e0e-4715-a133-4f06bf94e156 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:05.937652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333d4ee-2e0e-4715-a133-4f06bf94e156 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:05.960390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6b2df-b3e8-41f3-8ad7-0ff44d50aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:05.960689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6b2df-b3e8-41f3-8ad7-0ff44d50aad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:05.960970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6b2df-b3e8-41f3-8ad7-0ff44d50aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:05.961381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6b2df-b3e8-41f3-8ad7-0ff44d50aad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:05.961938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6b2df-b3e8-41f3-8ad7-0ff44d50aad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:05.963691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6b2df-b3e8-41f3-8ad7-0ff44d50aad8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:05.984546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 672/1345] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:05.988890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6b2df-b3e8-41f3-8ad7-0ff44d50aad8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:06.018790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6b2df-b3e8-41f3-8ad7-0ff44d50aad8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:06.019442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7c3a3d71af489ba32a7c0e814f6e65', 'request_id': 'req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:06.036382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7c3a3d71af489ba32a7c0e814f6e65', 'request_id': 'req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:06.047104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7c3a3d71af489ba32a7c0e814f6e65', 'request_id': 'req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:06.090933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] The token cache is being invalidate because project 9b7c3a3d71af489ba32a7c0e814f6e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:06.091283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:06.092047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7eaf4c64-208f-4a7d-a72d-3059d507f6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:06.094801 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 674/1346] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:05 2022] DELETE /identity/v3/projects/9b7c3a3d71af489ba32a7c0e814f6e65 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:34:06.099654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3eddf-8263-4a66-8205-dc7fb237cb80 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:06.100595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3eddf-8263-4a66-8205-dc7fb237cb80 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:06.100851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3eddf-8263-4a66-8205-dc7fb237cb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:06.124492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-16e3eddf-8263-4a66-8205-dc7fb237cb80 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:06.125824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-16e3eddf-8263-4a66-8205-dc7fb237cb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:06.167362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04229cc7-4abc-49ec-8c89-ebf380320e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:06.170662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04229cc7-4abc-49ec-8c89-ebf380320e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:06.174116 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04229cc7-4abc-49ec-8c89-ebf380320e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:06.175056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04229cc7-4abc-49ec-8c89-ebf380320e37 admin admin] PATH_INFO: `/v3/projects/e23be4a99ba048c8bf4ecce347f20862/users/e89567e003334eae80428ea996a9d885/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:06.223742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04229cc7-4abc-49ec-8c89-ebf380320e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23be4a99ba048c8bf4ecce347f20862, user_id=e89567e003334eae80428ea996a9d885, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:06.234065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04229cc7-4abc-49ec-8c89-ebf380320e37 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:06.258179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 675/1347] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:06.272516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 673/1348] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:05 2022] PUT /identity/v3/projects/e23be4a99ba048c8bf4ecce347f20862/users/e89567e003334eae80428ea996a9d885/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:06.273133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb498e4-4677-4174-860b-69d598d73c80 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:06.273715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb498e4-4677-4174-860b-69d598d73c80 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:06.274390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb498e4-4677-4174-860b-69d598d73c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:06.277469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04229cc7-4abc-49ec-8c89-ebf380320e37 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:06.279699 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-04229cc7-4abc-49ec-8c89-ebf380320e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:06.325652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3eb498e4-4677-4174-860b-69d598d73c80 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:06.326896 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3eb498e4-4677-4174-860b-69d598d73c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:06.405092 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:06.422354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04229cc7-4abc-49ec-8c89-ebf380320e37 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:06.430013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2c44-0845-4347-b1d8-9aafcab5c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:06.430966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2c44-0845-4347-b1d8-9aafcab5c191 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:06.431452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2c44-0845-4347-b1d8-9aafcab5c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:06.431975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2c44-0845-4347-b1d8-9aafcab5c191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:06.432942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de2c44-0845-4347-b1d8-9aafcab5c191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:06.437206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de2c44-0845-4347-b1d8-9aafcab5c191 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:06.474150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 676/1349] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:06.479018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb498e4-4677-4174-860b-69d598d73c80 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:06.495160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb498e4-4677-4174-860b-69d598d73c80 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:06.500869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 674/1350] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:06.502614 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2c44-0845-4347-b1d8-9aafcab5c191 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:06.512655 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29097e1-4e7e-412c-93e6-58124cd1b225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:06.513311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29097e1-4e7e-412c-93e6-58124cd1b225 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:06.513760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29097e1-4e7e-412c-93e6-58124cd1b225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:06.513871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29097e1-4e7e-412c-93e6-58124cd1b225 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:06.514637 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29097e1-4e7e-412c-93e6-58124cd1b225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:06.514941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29097e1-4e7e-412c-93e6-58124cd1b225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:06.516815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29097e1-4e7e-412c-93e6-58124cd1b225 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:06.520778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2c44-0845-4347-b1d8-9aafcab5c191 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:06.528646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12abb5-31bf-4162-a6a2-1d2f97f705b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:06.529520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12abb5-31bf-4162-a6a2-1d2f97f705b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:06.530217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12abb5-31bf-4162-a6a2-1d2f97f705b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:06.530682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12abb5-31bf-4162-a6a2-1d2f97f705b2 admin admin] PATH_INFO: `/v3/projects/e23be4a99ba048c8bf4ecce347f20862/users/e89567e003334eae80428ea996a9d885/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:06.535099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12abb5-31bf-4162-a6a2-1d2f97f705b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23be4a99ba048c8bf4ecce347f20862, user_id=e89567e003334eae80428ea996a9d885, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:06.538673 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12abb5-31bf-4162-a6a2-1d2f97f705b2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:06.553609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:06.556476 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 677/1351] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:06.561314 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29097e1-4e7e-412c-93e6-58124cd1b225 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:06.576277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29097e1-4e7e-412c-93e6-58124cd1b225 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:06.598247 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 675/1352] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:06 2022] PUT /identity/v3/projects/e23be4a99ba048c8bf4ecce347f20862/users/e89567e003334eae80428ea996a9d885/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:06.601116 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e5f7-8ce7-45be-a645-85a0f0183024 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:06.601526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e5f7-8ce7-45be-a645-85a0f0183024 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:06.601987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e5f7-8ce7-45be-a645-85a0f0183024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:06.653812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e801e5f7-8ce7-45be-a645-85a0f0183024 None None] MFA Rules not processed for user `e89567e003334eae80428ea996a9d885`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:06.654756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e801e5f7-8ce7-45be-a645-85a0f0183024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:06.734738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d8bda-cc31-4ef8-8cf1-57dcee817fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:06.735537 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d8bda-cc31-4ef8-8cf1-57dcee817fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:06.735919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d8bda-cc31-4ef8-8cf1-57dcee817fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:06.738686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d8bda-cc31-4ef8-8cf1-57dcee817fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:06.739482 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d8bda-cc31-4ef8-8cf1-57dcee817fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:06.759561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d8bda-cc31-4ef8-8cf1-57dcee817fbc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:06.843697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 678/1353] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:06 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:06.848750 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d8bda-cc31-4ef8-8cf1-57dcee817fbc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:06.863763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 676/1354] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:06 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:06.881846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801e5f7-8ce7-45be-a645-85a0f0183024 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:06.883669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e801e5f7-8ce7-45be-a645-85a0f0183024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:06.986930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801e5f7-8ce7-45be-a645-85a0f0183024 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:06.995684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d8bda-cc31-4ef8-8cf1-57dcee817fbc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:07.003683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f8484-7f01-4f4c-9803-96b2a905a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:07.004627 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f8484-7f01-4f4c-9803-96b2a905a8bc admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:07.005300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f8484-7f01-4f4c-9803-96b2a905a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:07.005720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f8484-7f01-4f4c-9803-96b2a905a8bc admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:07.007530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f8484-7f01-4f4c-9803-96b2a905a8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:07.009738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f8484-7f01-4f4c-9803-96b2a905a8bc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:07.060515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 679/1355] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:06 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:07.063087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f8484-7f01-4f4c-9803-96b2a905a8bc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:07.093916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f8484-7f01-4f4c-9803-96b2a905a8bc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:07.114014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdb476-dd67-4949-a898-378b4ae62e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:07.117358 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdb476-dd67-4949-a898-378b4ae62e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:07.117825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdb476-dd67-4949-a898-378b4ae62e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:07.118251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdb476-dd67-4949-a898-378b4ae62e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:07.119237 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdb476-dd67-4949-a898-378b4ae62e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:07.122430 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdb476-dd67-4949-a898-378b4ae62e5c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:07.122851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792db22-df41-4035-9511-ca95bfda935e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:07.124321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792db22-df41-4035-9511-ca95bfda935e service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:07.124793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792db22-df41-4035-9511-ca95bfda935e service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:07.126953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792db22-df41-4035-9511-ca95bfda935e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:07.150885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 680/1356] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:07.152040 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdb476-dd67-4949-a898-378b4ae62e5c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:07.172340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdb476-dd67-4949-a898-378b4ae62e5c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:07.225075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:07.228114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b7d0c-bca8-4c6c-aae7-b6e5f97cd170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:07.231030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b7d0c-bca8-4c6c-aae7-b6e5f97cd170 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:07.232704 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b7d0c-bca8-4c6c-aae7-b6e5f97cd170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:07.233873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b7d0c-bca8-4c6c-aae7-b6e5f97cd170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:07.237702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b7d0c-bca8-4c6c-aae7-b6e5f97cd170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:07.239763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b7d0c-bca8-4c6c-aae7-b6e5f97cd170 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:07.252977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792db22-df41-4035-9511-ca95bfda935e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:07.255449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792db22-df41-4035-9511-ca95bfda935e service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:07.298079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 681/1357] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:07.302214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 677/1358] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:06 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:07.310037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b7d0c-bca8-4c6c-aae7-b6e5f97cd170 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:07.339165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b7d0c-bca8-4c6c-aae7-b6e5f97cd170 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:07.357386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c79710-40f2-486f-88f9-611f18697181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:07.359741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c79710-40f2-486f-88f9-611f18697181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:07.361398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c79710-40f2-486f-88f9-611f18697181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:07.362191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c79710-40f2-486f-88f9-611f18697181 admin admin] PATH_INFO: `/v3/projects/c2cc585387494b77b1b5415356a3b177/users/5ba1c9c938a749e6b65a67dba290bd21/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:07.410781 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c79710-40f2-486f-88f9-611f18697181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2cc585387494b77b1b5415356a3b177, user_id=5ba1c9c938a749e6b65a67dba290bd21, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:07.416357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c79710-40f2-486f-88f9-611f18697181 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:07.425148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:07.451751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792db22-df41-4035-9511-ca95bfda935e service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:07.453066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5792db22-df41-4035-9511-ca95bfda935e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:07.472317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 682/1359] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:07 2022] PUT /identity/v3/projects/c2cc585387494b77b1b5415356a3b177/users/5ba1c9c938a749e6b65a67dba290bd21/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:07.473582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c79710-40f2-486f-88f9-611f18697181 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:07.492856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792db22-df41-4035-9511-ca95bfda935e service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:07.541727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c79710-40f2-486f-88f9-611f18697181 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:07.550577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d4eec-e489-4cd5-9ad6-ab886559652b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:07.551533 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d4eec-e489-4cd5-9ad6-ab886559652b service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:07.551897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d4eec-e489-4cd5-9ad6-ab886559652b service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:07.553528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d4eec-e489-4cd5-9ad6-ab886559652b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:07.556837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-188d4eec-e489-4cd5-9ad6-ab886559652b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:07.674368 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:07.680380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:07.680923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:07.686954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] PATH_INFO: `/v3/users/1b272bebbecb41939e37640b19038973` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:07.690037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b272bebbecb41939e37640b19038973)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:07.690483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d4eec-e489-4cd5-9ad6-ab886559652b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:07.691951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 03:34:07.691951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Nov 02 03:34:07.691951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: Nov 02 03:34:07.692264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d4eec-e489-4cd5-9ad6-ab886559652b service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:07.694351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:07.720990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 683/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:07.732813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380b48-9094-4880-b0ca-49af2380b376 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:07.739882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380b48-9094-4880-b0ca-49af2380b376 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:07.739882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380b48-9094-4880-b0ca-49af2380b376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:07.836397 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-29380b48-9094-4880-b0ca-49af2380b376 None None] MFA Rules not processed for user `5ba1c9c938a749e6b65a67dba290bd21`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:07.838903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-29380b48-9094-4880-b0ca-49af2380b376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:07.945358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b272bebbecb41939e37640b19038973'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:07.946606 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b272bebbecb41939e37640b19038973'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:07.977893 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 684/1361] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:07.978939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b272bebbecb41939e37640b19038973'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:07.983004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29380b48-9094-4880-b0ca-49af2380b376 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:07.995877 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b272bebbecb41939e37640b19038973'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:07.997224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b272bebbecb41939e37640b19038973'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:08.014348 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29380b48-9094-4880-b0ca-49af2380b376 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:08.029207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062c57a-a0af-46d5-b377-72dd1ba3f8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:08.029865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c57a-a0af-46d5-b377-72dd1ba3f8eb admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:08.030154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c57a-a0af-46d5-b377-72dd1ba3f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:08.030553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c57a-a0af-46d5-b377-72dd1ba3f8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:08.031129 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062c57a-a0af-46d5-b377-72dd1ba3f8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:08.034857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062c57a-a0af-46d5-b377-72dd1ba3f8eb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:08.072883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 678/1362] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:07 2022] DELETE /identity/v3/users/1b272bebbecb41939e37640b19038973 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:08.100373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 685/1363] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:07 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:08.106224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:08.108660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:08.375432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476fccb-d65d-46ca-9517-2470f92f6255 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:08.403863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:08.517842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9def0-d413-440a-b0e4-5e993753395e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:08.518235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9def0-d413-440a-b0e4-5e993753395e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:08.518622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9def0-d413-440a-b0e4-5e993753395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:08.593932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a3755-064d-4626-a08e-d6367b68df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:08.596187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a3755-064d-4626-a08e-d6367b68df96 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:08.596333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cce9def0-d413-440a-b0e4-5e993753395e None None] MFA Rules not processed for user `e0281fe66a8047f7ae0d8d7d48dc8470`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:08.601326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a3755-064d-4626-a08e-d6367b68df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:08.601326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a3755-064d-4626-a08e-d6367b68df96 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:08.601326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a3755-064d-4626-a08e-d6367b68df96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:08.602730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cce9def0-d413-440a-b0e4-5e993753395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:08.617367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a3755-064d-4626-a08e-d6367b68df96 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:08.635105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:08.696423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 679/1364] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:08 2022] POST /identity/v3/users => generated 300 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:08.707283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a3755-064d-4626-a08e-d6367b68df96 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:08.713842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-045a3755-064d-4626-a08e-d6367b68df96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:08.738982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a3755-064d-4626-a08e-d6367b68df96 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:08.756578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:08.757433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:08.757973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:08.758438 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] PATH_INFO: `/v3/projects/afed770d53444520ae229deacfd61f26` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:08.767457 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afed770d53444520ae229deacfd61f26)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:08.769527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:08.795231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 686/1365] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:08.796504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9def0-d413-440a-b0e4-5e993753395e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:08.809511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9def0-d413-440a-b0e4-5e993753395e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:08.815372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5434c5-f480-4f00-acef-154be6ee4a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:08.815997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5434c5-f480-4f00-acef-154be6ee4a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:08.816352 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5434c5-f480-4f00-acef-154be6ee4a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:08.816736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5434c5-f480-4f00-acef-154be6ee4a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:08.817456 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5434c5-f480-4f00-acef-154be6ee4a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:08.820385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5434c5-f480-4f00-acef-154be6ee4a45 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:08.833491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 687/1366] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:08.834757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5434c5-f480-4f00-acef-154be6ee4a45 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:08.836810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1e5434c5-f480-4f00-acef-154be6ee4a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:08.883968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afed770d53444520ae229deacfd61f26', 'request_id': 'req-12ed6835-a832-47aa-bffd-d4ed0beb60d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:08.894736 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afed770d53444520ae229deacfd61f26', 'request_id': 'req-12ed6835-a832-47aa-bffd-d4ed0beb60d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:08.914734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afed770d53444520ae229deacfd61f26', 'request_id': 'req-12ed6835-a832-47aa-bffd-d4ed0beb60d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:08.940366 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] The token cache is being invalidate because project afed770d53444520ae229deacfd61f26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:08.940741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:08.942845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:08.951826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 680/1367] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:08 2022] DELETE /identity/v3/projects/afed770d53444520ae229deacfd61f26 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:08.956434 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:08.957926 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:08.972585 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5434c5-f480-4f00-acef-154be6ee4a45 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:09.061604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed6835-a832-47aa-bffd-d4ed0beb60d9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:09.067487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60333d-f51e-4396-966b-6e289c572ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:09.069100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60333d-f51e-4396-966b-6e289c572ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:09.069100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60333d-f51e-4396-966b-6e289c572ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:09.069310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60333d-f51e-4396-966b-6e289c572ed0 admin admin] PATH_INFO: `/v3/projects/ded7d1dad87b4fa290bb19d7f8acb2f2/users/480092fbe99141b18d28ce5bb1c1e52b/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:09.085736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002075d5-b893-404a-a087-2f86a4edb681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:09.086628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002075d5-b893-404a-a087-2f86a4edb681 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:09.087157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002075d5-b893-404a-a087-2f86a4edb681 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:09.087621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002075d5-b893-404a-a087-2f86a4edb681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:09.089095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60333d-f51e-4396-966b-6e289c572ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded7d1dad87b4fa290bb19d7f8acb2f2, user_id=480092fbe99141b18d28ce5bb1c1e52b, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:09.090496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-002075d5-b893-404a-a087-2f86a4edb681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:09.091960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60333d-f51e-4396-966b-6e289c572ed0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:09.140276 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 681/1368] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:08 2022] PUT /identity/v3/projects/ded7d1dad87b4fa290bb19d7f8acb2f2/users/480092fbe99141b18d28ce5bb1c1e52b/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:09.141261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60333d-f51e-4396-966b-6e289c572ed0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:09.147832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6f60333d-f51e-4396-966b-6e289c572ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:09.159719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:09.168370 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:09.222258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002075d5-b893-404a-a087-2f86a4edb681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:09.224068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002075d5-b893-404a-a087-2f86a4edb681 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:09.250178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 688/1369] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:09.253661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60333d-f51e-4396-966b-6e289c572ed0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:09.254248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df32a9-2d9d-45ec-8417-488167b670a4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:09.255415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df32a9-2d9d-45ec-8417-488167b670a4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:09.257033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df32a9-2d9d-45ec-8417-488167b670a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:09.262468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:09.263283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:09.263757 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:09.264106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] PATH_INFO: `/v3/users/e62db526d1e44b38acbd1d3432649456` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:09.265709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e62db526d1e44b38acbd1d3432649456)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:09.268488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:09.349910 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e62db526d1e44b38acbd1d3432649456'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:09.350719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e62db526d1e44b38acbd1d3432649456'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:09.372361 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e62db526d1e44b38acbd1d3432649456'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:09.385762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e62db526d1e44b38acbd1d3432649456'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:09.386652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e62db526d1e44b38acbd1d3432649456'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:09.401555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-76df32a9-2d9d-45ec-8417-488167b670a4 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:09.403074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-76df32a9-2d9d-45ec-8417-488167b670a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:09.439644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 682/1370] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:09 2022] DELETE /identity/v3/users/e62db526d1e44b38acbd1d3432649456 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:09.440601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:09.450383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:09.626490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 689/1371] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:34:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:09.644812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bc23b-259c-4ab1-90e8-4b10c9ffaa44 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:09.682567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b5851-73a9-43c4-9cb4-25b34ce9c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:09.683323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b5851-73a9-43c4-9cb4-25b34ce9c616 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:09.683612 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b5851-73a9-43c4-9cb4-25b34ce9c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:09.683887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b5851-73a9-43c4-9cb4-25b34ce9c616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:09.684579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b5851-73a9-43c4-9cb4-25b34ce9c616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:09.700494 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b5851-73a9-43c4-9cb4-25b34ce9c616 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:09.727056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 683/1372] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:09.731026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df32a9-2d9d-45ec-8417-488167b670a4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:09.758868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df32a9-2d9d-45ec-8417-488167b670a4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:09.767585 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddabf53-dca0-410d-bcd8-02d15365854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:09.768417 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddabf53-dca0-410d-bcd8-02d15365854d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:09.768751 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddabf53-dca0-410d-bcd8-02d15365854d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:09.769437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddabf53-dca0-410d-bcd8-02d15365854d admin admin] PATH_INFO: `/v3/projects/ded7d1dad87b4fa290bb19d7f8acb2f2/users/480092fbe99141b18d28ce5bb1c1e52b/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:09.774231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddabf53-dca0-410d-bcd8-02d15365854d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded7d1dad87b4fa290bb19d7f8acb2f2, user_id=480092fbe99141b18d28ce5bb1c1e52b, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:09.781405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddabf53-dca0-410d-bcd8-02d15365854d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:09.812582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 690/1373] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:09 2022] PUT /identity/v3/projects/ded7d1dad87b4fa290bb19d7f8acb2f2/users/480092fbe99141b18d28ce5bb1c1e52b/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:09.823011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7359b2-cf40-4093-b738-002b1a6b05c8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:09.823394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7359b2-cf40-4093-b738-002b1a6b05c8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:09.823738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7359b2-cf40-4093-b738-002b1a6b05c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:09.901660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dc7359b2-cf40-4093-b738-002b1a6b05c8 None None] MFA Rules not processed for user `480092fbe99141b18d28ce5bb1c1e52b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:09.903473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dc7359b2-cf40-4093-b738-002b1a6b05c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:09.910559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddabf53-dca0-410d-bcd8-02d15365854d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:09.912760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7ddabf53-dca0-410d-bcd8-02d15365854d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:09.943409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:10.197450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 684/1374] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:10.211173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7359b2-cf40-4093-b738-002b1a6b05c8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:10.214693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dc7359b2-cf40-4093-b738-002b1a6b05c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:10.279729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddabf53-dca0-410d-bcd8-02d15365854d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:10.295964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d0f34-c609-4ab1-a461-e7fac0abb482 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:10.296819 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d0f34-c609-4ab1-a461-e7fac0abb482 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:10.297202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d0f34-c609-4ab1-a461-e7fac0abb482 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:10.298610 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d0f34-c609-4ab1-a461-e7fac0abb482 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:10.323370 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:10.387602 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7359b2-cf40-4093-b738-002b1a6b05c8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:10.400060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365d50b-1005-4f9a-b41b-95895d166ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:10.401611 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365d50b-1005-4f9a-b41b-95895d166ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:10.402181 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365d50b-1005-4f9a-b41b-95895d166ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:10.403332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365d50b-1005-4f9a-b41b-95895d166ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:10.425403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365d50b-1005-4f9a-b41b-95895d166ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:10.426979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365d50b-1005-4f9a-b41b-95895d166ae1 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:10.460383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 685/1375] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:10.479122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d0f34-c609-4ab1-a461-e7fac0abb482 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:10.482277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d0f34-c609-4ab1-a461-e7fac0abb482 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:10.516141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365d50b-1005-4f9a-b41b-95895d166ae1 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:10.527237 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 691/1376] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:34:10.766414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365d50b-1005-4f9a-b41b-95895d166ae1 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:10.790982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:10.791665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:10.791956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:10.792355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] PATH_INFO: `/v3/users/5ba1c9c938a749e6b65a67dba290bd21` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:10.801893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba1c9c938a749e6b65a67dba290bd21)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:10.809825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d0f34-c609-4ab1-a461-e7fac0abb482 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:10.811806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5e4d0f34-c609-4ab1-a461-e7fac0abb482 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:10.830190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:10.860491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d0f34-c609-4ab1-a461-e7fac0abb482 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:10.880082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:10.880820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:10.881215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:10.881711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] PATH_INFO: `/v3/projects/8aa139f1cea14f4787ab923d41218c75` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:10.889783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa139f1cea14f4787ab923d41218c75)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:10.895389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:10.999615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba1c9c938a749e6b65a67dba290bd21'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:11.001214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba1c9c938a749e6b65a67dba290bd21'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:11.014663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:11.036447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba1c9c938a749e6b65a67dba290bd21'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:11.063938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba1c9c938a749e6b65a67dba290bd21'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:11.064741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3c2872d-f0c5-4363-938b-8029f4d106d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba1c9c938a749e6b65a67dba290bd21'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:11.084102 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa139f1cea14f4787ab923d41218c75', 'request_id': 'req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:11.104143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa139f1cea14f4787ab923d41218c75', 'request_id': 'req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:11.122952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 686/1377] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:10 2022] DELETE /identity/v3/users/5ba1c9c938a749e6b65a67dba290bd21 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:34:11.127500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0375-487c-4bf4-9bc4-dda19cb58f0f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:11.128098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0375-487c-4bf4-9bc4-dda19cb58f0f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:11.128584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0375-487c-4bf4-9bc4-dda19cb58f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:11.133031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa139f1cea14f4787ab923d41218c75', 'request_id': 'req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:11.172582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a58f0375-487c-4bf4-9bc4-dda19cb58f0f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:11.174320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a58f0375-487c-4bf4-9bc4-dda19cb58f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:11.187976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] The token cache is being invalidate because project 8aa139f1cea14f4787ab923d41218c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:11.188611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:11.191012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7cb7377b-d4a2-4e6a-83fb-bc4830e63bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:11.202705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 692/1378] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:10 2022] DELETE /identity/v3/projects/8aa139f1cea14f4787ab923d41218c75 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:34:11.208246 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a62b2-de12-48ff-b01e-644c4d507bb9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:11.209666 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a62b2-de12-48ff-b01e-644c4d507bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:11.210882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a62b2-de12-48ff-b01e-644c4d507bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:11.298767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ff3a62b2-de12-48ff-b01e-644c4d507bb9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:11.307859 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ff3a62b2-de12-48ff-b01e-644c4d507bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:11.419327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 687/1379] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:11.516731 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 693/1380] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:11.530088 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8dd7-460d-44e8-9ee9-62ef11c100b9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:11.533094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8dd7-460d-44e8-9ee9-62ef11c100b9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:11.533094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8dd7-460d-44e8-9ee9-62ef11c100b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:11.556070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a62b2-de12-48ff-b01e-644c4d507bb9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:11.561713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ff3a62b2-de12-48ff-b01e-644c4d507bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:11.581515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-63bb8dd7-460d-44e8-9ee9-62ef11c100b9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:11.587497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63bb8dd7-460d-44e8-9ee9-62ef11c100b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:11.620672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 688/1381] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:11.621672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb8dd7-460d-44e8-9ee9-62ef11c100b9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:11.652221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb8dd7-460d-44e8-9ee9-62ef11c100b9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:11.668532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1135ca-e99b-48ac-a76f-75e87883e52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:11.669948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1135ca-e99b-48ac-a76f-75e87883e52e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:11.670273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1135ca-e99b-48ac-a76f-75e87883e52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:11.670510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1135ca-e99b-48ac-a76f-75e87883e52e admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:11.671724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1135ca-e99b-48ac-a76f-75e87883e52e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:11.672586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1135ca-e99b-48ac-a76f-75e87883e52e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:11.673676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1135ca-e99b-48ac-a76f-75e87883e52e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:11.716555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:11.728521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 689/1382] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:11.728706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1135ca-e99b-48ac-a76f-75e87883e52e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:11.774891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1135ca-e99b-48ac-a76f-75e87883e52e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:11.794703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d2242-62e1-413a-8f99-05dada683461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:11.795414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2242-62e1-413a-8f99-05dada683461 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:11.797492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2242-62e1-413a-8f99-05dada683461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:11.797781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2242-62e1-413a-8f99-05dada683461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:11.801458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d2242-62e1-413a-8f99-05dada683461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:11.812292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d2242-62e1-413a-8f99-05dada683461 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:11.820978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a62b2-de12-48ff-b01e-644c4d507bb9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:11.832886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc380f-03e1-4ce1-b6cf-e5ee6583e481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:11.833775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc380f-03e1-4ce1-b6cf-e5ee6583e481 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:11.835815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc380f-03e1-4ce1-b6cf-e5ee6583e481 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:11.836217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc380f-03e1-4ce1-b6cf-e5ee6583e481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:11.864365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc380f-03e1-4ce1-b6cf-e5ee6583e481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:11.868005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc380f-03e1-4ce1-b6cf-e5ee6583e481 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:11.897437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 694/1383] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:11.932888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 690/1384] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:11 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:11.933078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc380f-03e1-4ce1-b6cf-e5ee6583e481 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:11.954923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc380f-03e1-4ce1-b6cf-e5ee6583e481 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:12.251012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616e54b-cbd0-4bd4-abf6-184ba7aeaf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:12.251012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616e54b-cbd0-4bd4-abf6-184ba7aeaf1d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:12.251012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616e54b-cbd0-4bd4-abf6-184ba7aeaf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:12.251012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616e54b-cbd0-4bd4-abf6-184ba7aeaf1d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:12.251705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616e54b-cbd0-4bd4-abf6-184ba7aeaf1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:12.251705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616e54b-cbd0-4bd4-abf6-184ba7aeaf1d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:12.335357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d2242-62e1-413a-8f99-05dada683461 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:12.337622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 695/1385] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:11 2022] POST /identity/v3/users => generated 283 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:12.359846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d2242-62e1-413a-8f99-05dada683461 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:12.373226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43702f-9de6-4000-95d0-01c5772fd323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:12.374230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43702f-9de6-4000-95d0-01c5772fd323 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:12.374826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43702f-9de6-4000-95d0-01c5772fd323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:12.375338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43702f-9de6-4000-95d0-01c5772fd323 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:12.376204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43702f-9de6-4000-95d0-01c5772fd323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:12.386716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43702f-9de6-4000-95d0-01c5772fd323 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:12.430616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 691/1386] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:34:12.432530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616e54b-cbd0-4bd4-abf6-184ba7aeaf1d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:12.457587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616e54b-cbd0-4bd4-abf6-184ba7aeaf1d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:12.491296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b2e77-27ba-426e-9074-88b86db3bb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:12.492225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2e77-27ba-426e-9074-88b86db3bb6c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:12.492538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2e77-27ba-426e-9074-88b86db3bb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:12.494713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2e77-27ba-426e-9074-88b86db3bb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:12.497677 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b2e77-27ba-426e-9074-88b86db3bb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:12.500071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b2e77-27ba-426e-9074-88b86db3bb6c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:12.532997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 696/1387] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:12.534534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43702f-9de6-4000-95d0-01c5772fd323 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:12.566871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43702f-9de6-4000-95d0-01c5772fd323 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:12.592431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780490e-a1c0-42f1-9285-1d46d2c5ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:12.594053 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780490e-a1c0-42f1-9285-1d46d2c5ec7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:12.594760 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780490e-a1c0-42f1-9285-1d46d2c5ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:12.595444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780490e-a1c0-42f1-9285-1d46d2c5ec7d admin admin] PATH_INFO: `/v3/projects/39e62d3fc29c4c46a59e03874acc1b89/users/e4e8a0ab488e4803a4437aadfc9da4f6/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:12.627497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780490e-a1c0-42f1-9285-1d46d2c5ec7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e62d3fc29c4c46a59e03874acc1b89, user_id=e4e8a0ab488e4803a4437aadfc9da4f6, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:12.634282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780490e-a1c0-42f1-9285-1d46d2c5ec7d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:12.673572 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 692/1388] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:12 2022] PUT /identity/v3/projects/39e62d3fc29c4c46a59e03874acc1b89/users/e4e8a0ab488e4803a4437aadfc9da4f6/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:12.677295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277bfa-f237-42cf-b507-bb34d11579e5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:12.678101 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277bfa-f237-42cf-b507-bb34d11579e5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:12.678643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277bfa-f237-42cf-b507-bb34d11579e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:12.753935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0a277bfa-f237-42cf-b507-bb34d11579e5 None None] MFA Rules not processed for user `e4e8a0ab488e4803a4437aadfc9da4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:12.756210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0a277bfa-f237-42cf-b507-bb34d11579e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:12.914822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 697/1389] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:12.920782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780490e-a1c0-42f1-9285-1d46d2c5ec7d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:13.161631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:13.191412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780490e-a1c0-42f1-9285-1d46d2c5ec7d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:13.210573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968a54-b0fa-431b-9d77-c9763462c207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:13.211221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968a54-b0fa-431b-9d77-c9763462c207 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:13.211508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968a54-b0fa-431b-9d77-c9763462c207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:13.211786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968a54-b0fa-431b-9d77-c9763462c207 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:13.212445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968a54-b0fa-431b-9d77-c9763462c207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:13.218886 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968a54-b0fa-431b-9d77-c9763462c207 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:13.283440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 693/1390] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:12 2022] POST /identity/v3/projects => generated 367 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:13.287633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a277bfa-f237-42cf-b507-bb34d11579e5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:13.305913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a277bfa-f237-42cf-b507-bb34d11579e5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:13.461130 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:13.515853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e501a-6990-4b5c-aa57-167af9a57419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:13.517366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e501a-6990-4b5c-aa57-167af9a57419 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:13.517770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e501a-6990-4b5c-aa57-167af9a57419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:13.518192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e501a-6990-4b5c-aa57-167af9a57419 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:13.519176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e501a-6990-4b5c-aa57-167af9a57419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:13.521987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e501a-6990-4b5c-aa57-167af9a57419 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:13.573937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968a54-b0fa-431b-9d77-c9763462c207 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:13.574199 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 698/1391] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:13 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:13.593328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968a54-b0fa-431b-9d77-c9763462c207 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:13.614782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e296265-b07a-47b2-889d-ebb480cf9324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:13.616213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e296265-b07a-47b2-889d-ebb480cf9324 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:13.616702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e296265-b07a-47b2-889d-ebb480cf9324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:13.617124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e296265-b07a-47b2-889d-ebb480cf9324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:13.617928 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e296265-b07a-47b2-889d-ebb480cf9324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:13.622518 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e296265-b07a-47b2-889d-ebb480cf9324 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:13.651852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 694/1392] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:13.654339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e501a-6990-4b5c-aa57-167af9a57419 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:13.667907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e501a-6990-4b5c-aa57-167af9a57419 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:13.685698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661623f-affd-41db-8c9b-9e6d3365cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:13.686915 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661623f-affd-41db-8c9b-9e6d3365cd1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:13.686915 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661623f-affd-41db-8c9b-9e6d3365cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:13.687286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661623f-affd-41db-8c9b-9e6d3365cd1a admin admin] PATH_INFO: `/v3/projects/5147f2ebbaaa4104bb0441a912a5dcb8/users/6aae1ccc1db84791b037686c63891821/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:13.720505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661623f-affd-41db-8c9b-9e6d3365cd1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5147f2ebbaaa4104bb0441a912a5dcb8, user_id=6aae1ccc1db84791b037686c63891821, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:13.723540 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661623f-affd-41db-8c9b-9e6d3365cd1a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:13.761082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 699/1393] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:13 2022] PUT /identity/v3/projects/5147f2ebbaaa4104bb0441a912a5dcb8/users/6aae1ccc1db84791b037686c63891821/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:13.765158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e296265-b07a-47b2-889d-ebb480cf9324 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:13.787522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e296265-b07a-47b2-889d-ebb480cf9324 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:13.966049 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5b9b6-d3b4-498a-add8-f00a494b9ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:13.967771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5b9b6-d3b4-498a-add8-f00a494b9ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:13.967771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5b9b6-d3b4-498a-add8-f00a494b9ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:13.967771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5b9b6-d3b4-498a-add8-f00a494b9ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:13.974039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5b9b6-d3b4-498a-add8-f00a494b9ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:13.985129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5b9b6-d3b4-498a-add8-f00a494b9ee1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:14.017156 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 695/1394] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:34:14.018542 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661623f-affd-41db-8c9b-9e6d3365cd1a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:14.032366 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5b9b6-d3b4-498a-add8-f00a494b9ee1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:14.035862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-26f5b9b6-d3b4-498a-add8-f00a494b9ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:14.055553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661623f-affd-41db-8c9b-9e6d3365cd1a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:14.067365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efea675-0148-4b44-828c-cb59990b151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:14.068620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efea675-0148-4b44-828c-cb59990b151f admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:14.070789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efea675-0148-4b44-828c-cb59990b151f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:14.071073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efea675-0148-4b44-828c-cb59990b151f admin admin] PATH_INFO: `/v3/projects/5147f2ebbaaa4104bb0441a912a5dcb8/users/6aae1ccc1db84791b037686c63891821/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:14.078337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efea675-0148-4b44-828c-cb59990b151f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5147f2ebbaaa4104bb0441a912a5dcb8, user_id=6aae1ccc1db84791b037686c63891821, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:14.082937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efea675-0148-4b44-828c-cb59990b151f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:14.089947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5b9b6-d3b4-498a-add8-f00a494b9ee1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:14.105027 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:14.105821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:14.112051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:14.112835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] PATH_INFO: `/v3/users/6e6a3aded04f4b62863c9cf0061de5b4` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:14.117771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6a3aded04f4b62863c9cf0061de5b4)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:14.123644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:14.131381 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 700/1395] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:14 2022] PUT /identity/v3/projects/5147f2ebbaaa4104bb0441a912a5dcb8/users/6aae1ccc1db84791b037686c63891821/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:14.142365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519589-743c-400a-9174-4d5e79b2d971 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:14.142658 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519589-743c-400a-9174-4d5e79b2d971 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:14.143492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519589-743c-400a-9174-4d5e79b2d971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:14.258011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-69519589-743c-400a-9174-4d5e79b2d971 None None] MFA Rules not processed for user `6aae1ccc1db84791b037686c63891821`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:14.261931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-69519589-743c-400a-9174-4d5e79b2d971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:14.290668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6a3aded04f4b62863c9cf0061de5b4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:14.346222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6a3aded04f4b62863c9cf0061de5b4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:14.433535 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6a3aded04f4b62863c9cf0061de5b4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:14.447230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6a3aded04f4b62863c9cf0061de5b4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:14.449199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6a3aded04f4b62863c9cf0061de5b4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:14.483776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 696/1396] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:14 2022] DELETE /identity/v3/users/6e6a3aded04f4b62863c9cf0061de5b4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:14.485955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:14.487996 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:14.562921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:14.598828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 701/1397] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:14.602094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4c70-37c9-4d9e-baa6-64b6c8a685a0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:14.602094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4c70-37c9-4d9e-baa6-64b6c8a685a0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:14.602719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4c70-37c9-4d9e-baa6-64b6c8a685a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:14.608183 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f58ac-1cc3-4113-87d5-ddcc30f2d535 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:14.614565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:14.617022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:14.617981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:14.618694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] PATH_INFO: `/v3/projects/c2cc585387494b77b1b5415356a3b177` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:14.620712 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2cc585387494b77b1b5415356a3b177)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:14.623295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:14.700107 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2cc585387494b77b1b5415356a3b177', 'request_id': 'req-134c85e9-e336-4bc0-90aa-951ba972d13e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:14.706616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5e1a4c70-37c9-4d9e-baa6-64b6c8a685a0 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:14.708366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5e1a4c70-37c9-4d9e-baa6-64b6c8a685a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:14.709849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2cc585387494b77b1b5415356a3b177', 'request_id': 'req-134c85e9-e336-4bc0-90aa-951ba972d13e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:14.724586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2cc585387494b77b1b5415356a3b177', 'request_id': 'req-134c85e9-e336-4bc0-90aa-951ba972d13e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:14.746515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] The token cache is being invalidate because project c2cc585387494b77b1b5415356a3b177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:14.747392 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:14.748648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:14.751226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 697/1398] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:14 2022] DELETE /identity/v3/projects/c2cc585387494b77b1b5415356a3b177 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:14.752531 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:14.755021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:14.857892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c85e9-e336-4bc0-90aa-951ba972d13e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:14.884335 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43a771-1b47-466f-8f0a-f809f5fb5150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:14.889018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43a771-1b47-466f-8f0a-f809f5fb5150 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:14.889169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43a771-1b47-466f-8f0a-f809f5fb5150 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:14.893069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43a771-1b47-466f-8f0a-f809f5fb5150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:14.897153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eb43a771-1b47-466f-8f0a-f809f5fb5150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:14.994218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 702/1399] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:14.998409 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a4c70-37c9-4d9e-baa6-64b6c8a685a0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:15.001329 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5e1a4c70-37c9-4d9e-baa6-64b6c8a685a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:15.049308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a4c70-37c9-4d9e-baa6-64b6c8a685a0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:15.060936 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:15.061784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:15.062138 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:15.062481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] PATH_INFO: `/v3/users/480092fbe99141b18d28ce5bb1c1e52b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:15.065456 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=480092fbe99141b18d28ce5bb1c1e52b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:15.071415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:15.114623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43a771-1b47-466f-8f0a-f809f5fb5150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:15.116851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43a771-1b47-466f-8f0a-f809f5fb5150 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:15.149141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 698/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:15.150725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43a771-1b47-466f-8f0a-f809f5fb5150 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:15.153510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eb43a771-1b47-466f-8f0a-f809f5fb5150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:15.163625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:15.238169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:15.295051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480092fbe99141b18d28ce5bb1c1e52b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:15.296811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480092fbe99141b18d28ce5bb1c1e52b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:15.344719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480092fbe99141b18d28ce5bb1c1e52b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:15.347937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480092fbe99141b18d28ce5bb1c1e52b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:15.431368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480092fbe99141b18d28ce5bb1c1e52b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:15.473100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43a771-1b47-466f-8f0a-f809f5fb5150 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:15.495074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdc1a4-8408-4613-b539-49d189b16d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:15.499358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdc1a4-8408-4613-b539-49d189b16d6f service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:15.503710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 703/1401] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:14 2022] DELETE /identity/v3/users/480092fbe99141b18d28ce5bb1c1e52b => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:15.508762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdc1a4-8408-4613-b539-49d189b16d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:15.509466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:15.509867 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdc1a4-8408-4613-b539-49d189b16d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:15.539709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:15.543876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-61cdc1a4-8408-4613-b539-49d189b16d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:15.611446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdc1a4-8408-4613-b539-49d189b16d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:15.617483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdc1a4-8408-4613-b539-49d189b16d6f service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:15.641884 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 699/1402] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:15.761806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56424906-a6de-4ac9-9692-6decf5ce06fd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:15.774615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a4c0c-cf97-44ee-a3c0-e1541fa0fbba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:15.774615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a4c0c-cf97-44ee-a3c0-e1541fa0fbba service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:15.774615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a4c0c-cf97-44ee-a3c0-e1541fa0fbba service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:15.774968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a4c0c-cf97-44ee-a3c0-e1541fa0fbba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:15.779965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f63a4c0c-cf97-44ee-a3c0-e1541fa0fbba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:15.922756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a4c0c-cf97-44ee-a3c0-e1541fa0fbba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:15.924972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a4c0c-cf97-44ee-a3c0-e1541fa0fbba service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:15.955309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 704/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:17.514933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52324ff2-da5a-4801-81a0-57146598ffa0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:17.515438 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52324ff2-da5a-4801-81a0-57146598ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:17.515710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52324ff2-da5a-4801-81a0-57146598ffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:17.549950 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-52324ff2-da5a-4801-81a0-57146598ffa0 None None] MFA Rules not processed for user `aea5fababc0a497686549ed7b9b85c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:17.564072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-52324ff2-da5a-4801-81a0-57146598ffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:17.686795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 700/1404] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Nov 2 03:34:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:17.875895 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a4c0c-cf97-44ee-a3c0-e1541fa0fbba service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:17.877428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f63a4c0c-cf97-44ee-a3c0-e1541fa0fbba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:17.900850 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a4c0c-cf97-44ee-a3c0-e1541fa0fbba service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:17.915465 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f8a9-e323-43ce-b514-666c4b7c735a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:17.917623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f8a9-e323-43ce-b514-666c4b7c735a service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:17.917952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f8a9-e323-43ce-b514-666c4b7c735a service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:17.918232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f8a9-e323-43ce-b514-666c4b7c735a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:17.944968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62f8a9-e323-43ce-b514-666c4b7c735a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:17.949571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62f8a9-e323-43ce-b514-666c4b7c735a service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:17.976664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 705/1405] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:18.980239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52324ff2-da5a-4801-81a0-57146598ffa0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:18.982574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-52324ff2-da5a-4801-81a0-57146598ffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:19.170761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52324ff2-da5a-4801-81a0-57146598ffa0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:19.184338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:19.184955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:19.185350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:19.185523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] PATH_INFO: `/v3/projects/91a84e6871924615aec2aa95641312ce` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:19.188392 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a84e6871924615aec2aa95641312ce)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:19.189380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:19.348062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a84e6871924615aec2aa95641312ce', 'request_id': 'req-88587b6a-ea2e-4656-900c-ee9bd772ea67'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:19.374993 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a84e6871924615aec2aa95641312ce', 'request_id': 'req-88587b6a-ea2e-4656-900c-ee9bd772ea67'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:19.428719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a84e6871924615aec2aa95641312ce', 'request_id': 'req-88587b6a-ea2e-4656-900c-ee9bd772ea67'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:19.459831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:19.473667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] The token cache is being invalidate because project 91a84e6871924615aec2aa95641312ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:19.475392 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:19.482833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:19.500621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 701/1406] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:18 2022] DELETE /identity/v3/projects/91a84e6871924615aec2aa95641312ce => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:19.501956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f8a9-e323-43ce-b514-666c4b7c735a service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:19.517588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f8a9-e323-43ce-b514-666c4b7c735a service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:19.627274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:19.709373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:19.711710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:19.712674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:19.714738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] PATH_INFO: `/v3/users/e89567e003334eae80428ea996a9d885` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:19.716473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89567e003334eae80428ea996a9d885)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:19.721611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:19.853213 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89567e003334eae80428ea996a9d885'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:19.854879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89567e003334eae80428ea996a9d885'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:19.873667 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89567e003334eae80428ea996a9d885'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:19.875387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89567e003334eae80428ea996a9d885'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:19.908544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a783f1a5-ed1c-4e60-8174-ade295138477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89567e003334eae80428ea996a9d885'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:19.945462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 706/1407] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:19 2022] DELETE /identity/v3/users/e89567e003334eae80428ea996a9d885 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:20.292498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:20.296517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:20.359381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88587b6a-ea2e-4656-900c-ee9bd772ea67 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:20.611714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:20.617908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:20.618196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:20.618487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] PATH_INFO: `/v3/projects/ded7d1dad87b4fa290bb19d7f8acb2f2` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:20.626156 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded7d1dad87b4fa290bb19d7f8acb2f2)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:20.628092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:20.769130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded7d1dad87b4fa290bb19d7f8acb2f2', 'request_id': 'req-4170d792-dad2-422c-ad85-ffd81212bfec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:20.779424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded7d1dad87b4fa290bb19d7f8acb2f2', 'request_id': 'req-4170d792-dad2-422c-ad85-ffd81212bfec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:20.789010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded7d1dad87b4fa290bb19d7f8acb2f2', 'request_id': 'req-4170d792-dad2-422c-ad85-ffd81212bfec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:20.816662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] The token cache is being invalidate because project ded7d1dad87b4fa290bb19d7f8acb2f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:20.817094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:20.817819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4170d792-dad2-422c-ad85-ffd81212bfec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:20.820023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 702/1408] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:20 2022] DELETE /identity/v3/projects/ded7d1dad87b4fa290bb19d7f8acb2f2 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:20.830169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222291c0-658c-4d6e-b1d7-1ef5da5f6e54 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:20.830711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222291c0-658c-4d6e-b1d7-1ef5da5f6e54 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:20.830711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222291c0-658c-4d6e-b1d7-1ef5da5f6e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:20.839359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93678f1-be3e-48f4-a195-564b16edd492 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:20.839762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93678f1-be3e-48f4-a195-564b16edd492 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:20.840216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93678f1-be3e-48f4-a195-564b16edd492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:20.901450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-222291c0-658c-4d6e-b1d7-1ef5da5f6e54 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:20.904258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-222291c0-658c-4d6e-b1d7-1ef5da5f6e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:20.941358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c93678f1-be3e-48f4-a195-564b16edd492 None None] MFA Rules not processed for user `cbdfd88ab0f448e48e86379efa48a8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:20.944228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c93678f1-be3e-48f4-a195-564b16edd492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:21.057981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 707/1409] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:21.060613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb63f9-a9b2-48bd-86ca-c39cc622ee76 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:21.061037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb63f9-a9b2-48bd-86ca-c39cc622ee76 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:21.061556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb63f9-a9b2-48bd-86ca-c39cc622ee76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:21.153693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-75cb63f9-a9b2-48bd-86ca-c39cc622ee76 None None] MFA Rules not processed for user `78ca6fbbda31433bbe598ce667103cae`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:21.156767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-75cb63f9-a9b2-48bd-86ca-c39cc622ee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:21.157400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 703/1410] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:21.161266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbf7ed-e40e-4260-b1cc-b76999bf4d7e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:21.162583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbf7ed-e40e-4260-b1cc-b76999bf4d7e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:21.164411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbf7ed-e40e-4260-b1cc-b76999bf4d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:21.213824 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3bfbf7ed-e40e-4260-b1cc-b76999bf4d7e None None] MFA Rules not processed for user `e0281fe66a8047f7ae0d8d7d48dc8470`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:21.245966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3bfbf7ed-e40e-4260-b1cc-b76999bf4d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:21.307503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:21.347552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:21.420413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 708/1411] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:21.422887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6e6b-2735-47a1-a3ed-8eb7226553ca None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:21.423336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6e6b-2735-47a1-a3ed-8eb7226553ca None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:21.424045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6e6b-2735-47a1-a3ed-8eb7226553ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:21.451987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 704/1412] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:21.451987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbf7ed-e40e-4260-b1cc-b76999bf4d7e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:21.458163 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3bfbf7ed-e40e-4260-b1cc-b76999bf4d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:21.490926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-03eb6e6b-2735-47a1-a3ed-8eb7226553ca None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:21.493194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-03eb6e6b-2735-47a1-a3ed-8eb7226553ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:21.511619 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 709/1413] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:21.514458 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6e6b-2735-47a1-a3ed-8eb7226553ca None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:21.529532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6e6b-2735-47a1-a3ed-8eb7226553ca None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:21.562293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa28d11-05e8-45eb-bff2-89acb9747ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:21.563389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28d11-05e8-45eb-bff2-89acb9747ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:21.563760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28d11-05e8-45eb-bff2-89acb9747ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:21.564222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28d11-05e8-45eb-bff2-89acb9747ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:21.565941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa28d11-05e8-45eb-bff2-89acb9747ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:21.566485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa28d11-05e8-45eb-bff2-89acb9747ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:21.571400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa28d11-05e8-45eb-bff2-89acb9747ee7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:21.594262 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 710/1414] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:21.596327 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa28d11-05e8-45eb-bff2-89acb9747ee7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:21.619494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa28d11-05e8-45eb-bff2-89acb9747ee7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:21.627497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc8c21-a160-4ebb-9c7a-4f27dbc891cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:21.628627 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc8c21-a160-4ebb-9c7a-4f27dbc891cf admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:21.628915 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc8c21-a160-4ebb-9c7a-4f27dbc891cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:21.629190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc8c21-a160-4ebb-9c7a-4f27dbc891cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:21.629897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc8c21-a160-4ebb-9c7a-4f27dbc891cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:21.632353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc8c21-a160-4ebb-9c7a-4f27dbc891cf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:21.660448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbf7ed-e40e-4260-b1cc-b76999bf4d7e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:21.679710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09571150-f4c2-4795-8511-cd6450d598d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:21.680489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09571150-f4c2-4795-8511-cd6450d598d8 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:21.680854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09571150-f4c2-4795-8511-cd6450d598d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:21.681043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09571150-f4c2-4795-8511-cd6450d598d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:21.690300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 711/1415] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:21 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:21.691305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc8c21-a160-4ebb-9c7a-4f27dbc891cf admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:21.695084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-80bc8c21-a160-4ebb-9c7a-4f27dbc891cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:21.697509 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09571150-f4c2-4795-8511-cd6450d598d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:21.699307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09571150-f4c2-4795-8511-cd6450d598d8 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:21.728833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 705/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:21.729739 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09571150-f4c2-4795-8511-cd6450d598d8 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:21.755338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09571150-f4c2-4795-8511-cd6450d598d8 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:21.875087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc8c21-a160-4ebb-9c7a-4f27dbc891cf admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:21.898968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd7b3b-ba49-4cc7-beda-111f087cde3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:21.899703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd7b3b-ba49-4cc7-beda-111f087cde3c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:21.900057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd7b3b-ba49-4cc7-beda-111f087cde3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:21.900400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd7b3b-ba49-4cc7-beda-111f087cde3c admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:21.901198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd7b3b-ba49-4cc7-beda-111f087cde3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:21.903230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd7b3b-ba49-4cc7-beda-111f087cde3c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:21.910642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04343e28-b31d-4f65-ac56-e9786aaefd50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:21.910952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343e28-b31d-4f65-ac56-e9786aaefd50 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:21.913223 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343e28-b31d-4f65-ac56-e9786aaefd50 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:21.914226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343e28-b31d-4f65-ac56-e9786aaefd50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:21.959065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 706/1417] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:21 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:21.960827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd7b3b-ba49-4cc7-beda-111f087cde3c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:21.976848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd7b3b-ba49-4cc7-beda-111f087cde3c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:21.990388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5468-d944-4b25-8e08-bb1f3f735f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:21.991193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5468-d944-4b25-8e08-bb1f3f735f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:21.991647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5468-d944-4b25-8e08-bb1f3f735f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:21.992033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5468-d944-4b25-8e08-bb1f3f735f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:21.992815 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5468-d944-4b25-8e08-bb1f3f735f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:21.994520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5468-d944-4b25-8e08-bb1f3f735f23 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:22.029724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 707/1418] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:22.034532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5468-d944-4b25-8e08-bb1f3f735f23 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:22.075068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5468-d944-4b25-8e08-bb1f3f735f23 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:22.102358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e10203-219c-4fee-bb92-2538616dcc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:22.103140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e10203-219c-4fee-bb92-2538616dcc6d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:22.103532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e10203-219c-4fee-bb92-2538616dcc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:22.103902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e10203-219c-4fee-bb92-2538616dcc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:22.106537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e10203-219c-4fee-bb92-2538616dcc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:22.110624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e10203-219c-4fee-bb92-2538616dcc6d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:22.124367 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04343e28-b31d-4f65-ac56-e9786aaefd50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:22.126580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04343e28-b31d-4f65-ac56-e9786aaefd50 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:22.143532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 708/1419] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:22.148843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e10203-219c-4fee-bb92-2538616dcc6d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:22.154692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 712/1420] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:22.210756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e10203-219c-4fee-bb92-2538616dcc6d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:22.231915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84841fb-4782-43d8-8f0a-786fbfc33743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:22.232734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84841fb-4782-43d8-8f0a-786fbfc33743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:22.232891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84841fb-4782-43d8-8f0a-786fbfc33743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:22.233168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84841fb-4782-43d8-8f0a-786fbfc33743 admin admin] PATH_INFO: `/v3/projects/be54a5d418204b8aaa34d1e0fc1b160c/users/4e55bec3a0c44a18bc176819c474e751/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:22.251262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:22.256254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84841fb-4782-43d8-8f0a-786fbfc33743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be54a5d418204b8aaa34d1e0fc1b160c, user_id=4e55bec3a0c44a18bc176819c474e751, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:22.259308 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84841fb-4782-43d8-8f0a-786fbfc33743 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:22.295520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 709/1421] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:22 2022] PUT /identity/v3/projects/be54a5d418204b8aaa34d1e0fc1b160c/users/4e55bec3a0c44a18bc176819c474e751/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:34:22.313168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4188-5ec3-4a49-89d6-7428b382e25c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:22.315866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4188-5ec3-4a49-89d6-7428b382e25c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:22.316236 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4188-5ec3-4a49-89d6-7428b382e25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:22.324777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84841fb-4782-43d8-8f0a-786fbfc33743 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:22.327230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b84841fb-4782-43d8-8f0a-786fbfc33743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:22.394767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ad8b4188-5ec3-4a49-89d6-7428b382e25c None None] MFA Rules not processed for user `4e55bec3a0c44a18bc176819c474e751`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:22.397700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ad8b4188-5ec3-4a49-89d6-7428b382e25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:22.484282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:22.567665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84841fb-4782-43d8-8f0a-786fbfc33743 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:22.580594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:22.581961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:22.582458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:22.583053 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] PATH_INFO: `/v3/projects/e23be4a99ba048c8bf4ecce347f20862` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:22.585561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23be4a99ba048c8bf4ecce347f20862)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:22.588904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:22.632421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 713/1422] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:22.637217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b4188-5ec3-4a49-89d6-7428b382e25c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:22.666067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b4188-5ec3-4a49-89d6-7428b382e25c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:22.706105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23be4a99ba048c8bf4ecce347f20862', 'request_id': 'req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:22.721605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23be4a99ba048c8bf4ecce347f20862', 'request_id': 'req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:22.749728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23be4a99ba048c8bf4ecce347f20862', 'request_id': 'req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:22.775444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] The token cache is being invalidate because project e23be4a99ba048c8bf4ecce347f20862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:22.775742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:22.778709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0749a8-8a67-489d-b47d-b0fd1ac642ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:22.783449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 710/1423] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:22 2022] DELETE /identity/v3/projects/e23be4a99ba048c8bf4ecce347f20862 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:22.794850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954650-139e-4fb4-bbf8-51b37ebc5325 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:22.796228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954650-139e-4fb4-bbf8-51b37ebc5325 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:22.796538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954650-139e-4fb4-bbf8-51b37ebc5325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:22.824541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba634d27-1ff5-4764-9c54-9b793dded509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:22.825424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba634d27-1ff5-4764-9c54-9b793dded509 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:22.825874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba634d27-1ff5-4764-9c54-9b793dded509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:22.826443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba634d27-1ff5-4764-9c54-9b793dded509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:22.827284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba634d27-1ff5-4764-9c54-9b793dded509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:22.829687 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba634d27-1ff5-4764-9c54-9b793dded509 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:22.871616 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7a954650-139e-4fb4-bbf8-51b37ebc5325 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:22.882896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a954650-139e-4fb4-bbf8-51b37ebc5325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:22.885292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 714/1424] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:22 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:22.889591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba634d27-1ff5-4764-9c54-9b793dded509 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:22.892319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ba634d27-1ff5-4764-9c54-9b793dded509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:23.057975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 711/1425] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:23.063977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a79be-1712-487f-a387-84aef3b2aa08 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:23.064268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a79be-1712-487f-a387-84aef3b2aa08 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:23.072757 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a79be-1712-487f-a387-84aef3b2aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:23.142932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-627a79be-1712-487f-a387-84aef3b2aa08 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:23.144731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-627a79be-1712-487f-a387-84aef3b2aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:23.177647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 712/1426] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:23.178883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a79be-1712-487f-a387-84aef3b2aa08 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:23.200350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a79be-1712-487f-a387-84aef3b2aa08 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:23.215785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9483ac-a9d4-4291-94ac-8c4aab2116a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:23.216450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9483ac-a9d4-4291-94ac-8c4aab2116a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:23.216838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9483ac-a9d4-4291-94ac-8c4aab2116a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:23.217663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9483ac-a9d4-4291-94ac-8c4aab2116a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:23.218155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9483ac-a9d4-4291-94ac-8c4aab2116a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:23.218317 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9483ac-a9d4-4291-94ac-8c4aab2116a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:23.221018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9483ac-a9d4-4291-94ac-8c4aab2116a5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:23.251955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 713/1427] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:23.257724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9483ac-a9d4-4291-94ac-8c4aab2116a5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:23.267124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:23.287560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9483ac-a9d4-4291-94ac-8c4aab2116a5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:23.301840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d6d8f-98d4-49f8-87ee-363ee96f1583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:23.304665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d6d8f-98d4-49f8-87ee-363ee96f1583 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:23.308186 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d6d8f-98d4-49f8-87ee-363ee96f1583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:23.308710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d6d8f-98d4-49f8-87ee-363ee96f1583 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:23.310378 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d6d8f-98d4-49f8-87ee-363ee96f1583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:23.313870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d6d8f-98d4-49f8-87ee-363ee96f1583 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:23.374050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba634d27-1ff5-4764-9c54-9b793dded509 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:23.384670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a720af-8da2-4047-a039-f993c96011ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:23.385490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a720af-8da2-4047-a039-f993c96011ee admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:23.385862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a720af-8da2-4047-a039-f993c96011ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:23.386371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a720af-8da2-4047-a039-f993c96011ee admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:23.387120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a720af-8da2-4047-a039-f993c96011ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:23.390454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a720af-8da2-4047-a039-f993c96011ee admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:23.394843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 714/1428] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:23 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:23.396109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d6d8f-98d4-49f8-87ee-363ee96f1583 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:23.459920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 715/1429] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:22 2022] POST /identity/v3/users => generated 300 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:23.463499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a720af-8da2-4047-a039-f993c96011ee admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:23.479636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a720af-8da2-4047-a039-f993c96011ee admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:23.543565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:23.564203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d6d8f-98d4-49f8-87ee-363ee96f1583 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:23.576368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c32041-6d7e-4563-9fa9-9b36dd7c8b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:23.577851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c32041-6d7e-4563-9fa9-9b36dd7c8b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:23.578319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c32041-6d7e-4563-9fa9-9b36dd7c8b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:23.578735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c32041-6d7e-4563-9fa9-9b36dd7c8b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:23.579726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c32041-6d7e-4563-9fa9-9b36dd7c8b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:23.581972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c32041-6d7e-4563-9fa9-9b36dd7c8b12 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:23.600117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af6be-c2c8-41fa-a57b-19fc1b6fb183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:23.602772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af6be-c2c8-41fa-a57b-19fc1b6fb183 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:23.605359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af6be-c2c8-41fa-a57b-19fc1b6fb183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:23.606763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af6be-c2c8-41fa-a57b-19fc1b6fb183 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:23.608196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8af6be-c2c8-41fa-a57b-19fc1b6fb183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:23.612180 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8af6be-c2c8-41fa-a57b-19fc1b6fb183 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:23.616337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 716/1430] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:23.621621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c32041-6d7e-4563-9fa9-9b36dd7c8b12 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:23.675347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 715/1431] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:23 2022] POST /identity/v3/users => generated 287 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:23.680668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af6be-c2c8-41fa-a57b-19fc1b6fb183 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:23.681202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c32041-6d7e-4563-9fa9-9b36dd7c8b12 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:23.702373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b20e9-7b37-4afb-a982-611da5fcae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:23.706714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b20e9-7b37-4afb-a982-611da5fcae47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:23.707000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b20e9-7b37-4afb-a982-611da5fcae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:23.707278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b20e9-7b37-4afb-a982-611da5fcae47 admin admin] PATH_INFO: `/v3/projects/8b312a089b1547fb840dbd4ba01816ac/users/0707616ae868470eb141b97e679c956d/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:23.723301 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af6be-c2c8-41fa-a57b-19fc1b6fb183 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:23.743389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e116881-d5de-495a-b2c4-70ae69c0e46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:23.744621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116881-d5de-495a-b2c4-70ae69c0e46e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:23.746909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116881-d5de-495a-b2c4-70ae69c0e46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:23.748296 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116881-d5de-495a-b2c4-70ae69c0e46e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:23.751851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e116881-d5de-495a-b2c4-70ae69c0e46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:23.755788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e116881-d5de-495a-b2c4-70ae69c0e46e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:23.759291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b20e9-7b37-4afb-a982-611da5fcae47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b312a089b1547fb840dbd4ba01816ac, user_id=0707616ae868470eb141b97e679c956d, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:23.765177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b20e9-7b37-4afb-a982-611da5fcae47 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:23.800980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 716/1432] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:23.805614 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e116881-d5de-495a-b2c4-70ae69c0e46e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:23.842109 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 717/1433] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:23 2022] PUT /identity/v3/projects/8b312a089b1547fb840dbd4ba01816ac/users/0707616ae868470eb141b97e679c956d/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:23.843995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b20e9-7b37-4afb-a982-611da5fcae47 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:23.847987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e116881-d5de-495a-b2c4-70ae69c0e46e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:23.850072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d94b20e9-7b37-4afb-a982-611da5fcae47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:24.054534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e5972-1c1e-46a2-bc5b-bfc3714f273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:24.055198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e5972-1c1e-46a2-bc5b-bfc3714f273c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.055718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e5972-1c1e-46a2-bc5b-bfc3714f273c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.056021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e5972-1c1e-46a2-bc5b-bfc3714f273c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.056673 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e5972-1c1e-46a2-bc5b-bfc3714f273c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:24.059984 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e5972-1c1e-46a2-bc5b-bfc3714f273c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:24.120376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b20e9-7b37-4afb-a982-611da5fcae47 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:24.120960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 717/1434] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:24.121543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e5972-1c1e-46a2-bc5b-bfc3714f273c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:24.132294 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:24.133192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.133603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.134786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] PATH_INFO: `/v3/users/e4e8a0ab488e4803a4437aadfc9da4f6` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.137956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e8a0ab488e4803a4437aadfc9da4f6)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:24.142667 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:24.159249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e5972-1c1e-46a2-bc5b-bfc3714f273c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:24.166331 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb5545-92c4-48a2-9ed2-3d8df38bfa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:24.186713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb5545-92c4-48a2-9ed2-3d8df38bfa5b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.187055 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb5545-92c4-48a2-9ed2-3d8df38bfa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.187273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb5545-92c4-48a2-9ed2-3d8df38bfa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.193885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb5545-92c4-48a2-9ed2-3d8df38bfa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:24.199232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb5545-92c4-48a2-9ed2-3d8df38bfa5b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:24.242697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 718/1435] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:24.244350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24fa1-e4d2-4af8-9046-65f35b8eaae0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.244859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24fa1-e4d2-4af8-9046-65f35b8eaae0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.245396 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24fa1-e4d2-4af8-9046-65f35b8eaae0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.248044 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 719/1436] 10.222.0.20 () {54 vars in 912 bytes} [Wed Nov 2 03:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:34:24.248980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d24fa1-e4d2-4af8-9046-65f35b8eaae0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:24.266657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d24fa1-e4d2-4af8-9046-65f35b8eaae0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:24.272910 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755da838-9344-43ae-a7cf-fc4b22858925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:24.274668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da838-9344-43ae-a7cf-fc4b22858925 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.275117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da838-9344-43ae-a7cf-fc4b22858925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.275528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da838-9344-43ae-a7cf-fc4b22858925 admin admin] PATH_INFO: `/v3/projects/a36c1840d9c0479496397270560dfa12/users/f9558205f6b449e6b322455e288852fd/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.279849 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e8a0ab488e4803a4437aadfc9da4f6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:24.280979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e8a0ab488e4803a4437aadfc9da4f6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:24.300534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e8a0ab488e4803a4437aadfc9da4f6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:24.300534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e8a0ab488e4803a4437aadfc9da4f6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:24.309784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755da838-9344-43ae-a7cf-fc4b22858925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36c1840d9c0479496397270560dfa12, user_id=f9558205f6b449e6b322455e288852fd, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:24.326486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755da838-9344-43ae-a7cf-fc4b22858925 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:24.340961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8c5604c9-9237-4607-b3a6-6807a3251b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e8a0ab488e4803a4437aadfc9da4f6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:24.359811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 718/1437] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:23 2022] DELETE /identity/v3/users/e4e8a0ab488e4803a4437aadfc9da4f6 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:24.361549 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38614a-18b3-4248-9154-5748fa2af9c8 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.362221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38614a-18b3-4248-9154-5748fa2af9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.367140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 720/1438] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:24 2022] PUT /identity/v3/projects/a36c1840d9c0479496397270560dfa12/users/f9558205f6b449e6b322455e288852fd/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:24.367140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755da838-9344-43ae-a7cf-fc4b22858925 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:24.369383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38614a-18b3-4248-9154-5748fa2af9c8 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.371717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 719/1439] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:34:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:34:24.374436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-755da838-9344-43ae-a7cf-fc4b22858925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:24.374834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f34d6-e674-4520-bb79-2df6b341b347 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.375323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f34d6-e674-4520-bb79-2df6b341b347 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.375776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f34d6-e674-4520-bb79-2df6b341b347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.402079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c57f34d6-e674-4520-bb79-2df6b341b347 None None] MFA Rules not processed for user `aea5fababc0a497686549ed7b9b85c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:24.404021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c57f34d6-e674-4520-bb79-2df6b341b347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:24.446037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:24.481992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 720/1440] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:34:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:24.482697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:24.485232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b57d3-5854-4707-add3-e13df9878f4b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.485886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b57d3-5854-4707-add3-e13df9878f4b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.486448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b57d3-5854-4707-add3-e13df9878f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.549295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ea6b57d3-5854-4707-add3-e13df9878f4b None None] MFA Rules not processed for user `71e75366f8b44eb1a0af9d7f8498c7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:24.551246 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ea6b57d3-5854-4707-add3-e13df9878f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:24.654305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 721/1441] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:24.657486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b2dc7-12ec-4bd5-80a8-e65214dc65a3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.657892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b2dc7-12ec-4bd5-80a8-e65214dc65a3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.658177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b2dc7-12ec-4bd5-80a8-e65214dc65a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.691384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755da838-9344-43ae-a7cf-fc4b22858925 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:24.705075 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2d7b2dc7-12ec-4bd5-80a8-e65214dc65a3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:24.709516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2d7b2dc7-12ec-4bd5-80a8-e65214dc65a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:24.885204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191292ad-26b2-40e3-bf31-10b39a1458cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:24.885945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191292ad-26b2-40e3-bf31-10b39a1458cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.886394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191292ad-26b2-40e3-bf31-10b39a1458cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.886511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191292ad-26b2-40e3-bf31-10b39a1458cf admin admin] PATH_INFO: `/v3/projects/8b312a089b1547fb840dbd4ba01816ac/users/0707616ae868470eb141b97e679c956d/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.890662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191292ad-26b2-40e3-bf31-10b39a1458cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b312a089b1547fb840dbd4ba01816ac, user_id=0707616ae868470eb141b97e679c956d, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:24.894863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191292ad-26b2-40e3-bf31-10b39a1458cf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:24.898881 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 722/1442] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:24.901153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9b35-8456-4ba8-a558-9641b8fc16de None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.901153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9b35-8456-4ba8-a558-9641b8fc16de None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.901153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9b35-8456-4ba8-a558-9641b8fc16de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.921703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 721/1443] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:24 2022] PUT /identity/v3/projects/8b312a089b1547fb840dbd4ba01816ac/users/0707616ae868470eb141b97e679c956d/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:24.923284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65736f-55b7-4d11-acbf-5468eb83d91d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:24.923562 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65736f-55b7-4d11-acbf-5468eb83d91d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:24.923841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65736f-55b7-4d11-acbf-5468eb83d91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:24.939037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4e0f9b35-8456-4ba8-a558-9641b8fc16de None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:24.941183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4e0f9b35-8456-4ba8-a558-9641b8fc16de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:24.971693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7a65736f-55b7-4d11-acbf-5468eb83d91d None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:24.973084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a65736f-55b7-4d11-acbf-5468eb83d91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:25.028837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 723/1444] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:25.037418 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f9b35-8456-4ba8-a558-9641b8fc16de None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:25.045911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4e0f9b35-8456-4ba8-a558-9641b8fc16de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:25.102582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:25.143976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 722/1445] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:34:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:25.145166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf423-a310-42ac-a261-e1e532c6bd8a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:25.145454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf423-a310-42ac-a261-e1e532c6bd8a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:25.145729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf423-a310-42ac-a261-e1e532c6bd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:25.191445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-76bdf423-a310-42ac-a261-e1e532c6bd8a None None] MFA Rules not processed for user `71e75366f8b44eb1a0af9d7f8498c7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:25.197323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-76bdf423-a310-42ac-a261-e1e532c6bd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:25.230393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f9b35-8456-4ba8-a558-9641b8fc16de None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:25.253438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0105960-f711-48e1-8093-f4acbcfeb7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:25.254276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105960-f711-48e1-8093-f4acbcfeb7dc service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:25.254848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105960-f711-48e1-8093-f4acbcfeb7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:25.255153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105960-f711-48e1-8093-f4acbcfeb7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:25.267257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0105960-f711-48e1-8093-f4acbcfeb7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:25.269198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0105960-f711-48e1-8093-f4acbcfeb7dc service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:25.281957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 724/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:25.283839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aa065-62f0-46e3-b97a-1c1cb9032ba5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:25.284380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aa065-62f0-46e3-b97a-1c1cb9032ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:25.284728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aa065-62f0-46e3-b97a-1c1cb9032ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:25.307576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:25.334600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 723/1447] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:25.335474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdf423-a310-42ac-a261-e1e532c6bd8a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:25.355483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdf423-a310-42ac-a261-e1e532c6bd8a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:25.356577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-db6aa065-62f0-46e3-b97a-1c1cb9032ba5 None None] MFA Rules not processed for user `0707616ae868470eb141b97e679c956d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:25.362079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-db6aa065-62f0-46e3-b97a-1c1cb9032ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:25.363221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fbabf-afae-49ef-9d87-98440c58386f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:25.363977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fbabf-afae-49ef-9d87-98440c58386f service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:25.364374 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fbabf-afae-49ef-9d87-98440c58386f service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:25.365482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fbabf-afae-49ef-9d87-98440c58386f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:25.389768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fbabf-afae-49ef-9d87-98440c58386f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:25.391750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fbabf-afae-49ef-9d87-98440c58386f service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:25.416811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 724/1448] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:25.417786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fbabf-afae-49ef-9d87-98440c58386f service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:25.421607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-812fbabf-afae-49ef-9d87-98440c58386f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:25.450033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fbabf-afae-49ef-9d87-98440c58386f service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:25.454971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd245e-951e-4826-bbc7-1312ca37a522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:25.455727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd245e-951e-4826-bbc7-1312ca37a522 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:25.456113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd245e-951e-4826-bbc7-1312ca37a522 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:25.456641 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd245e-951e-4826-bbc7-1312ca37a522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:25.479857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd245e-951e-4826-bbc7-1312ca37a522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:25.481689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd245e-951e-4826-bbc7-1312ca37a522 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:25.507115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 725/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:25.551082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 725/1450] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:25.572497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd245e-951e-4826-bbc7-1312ca37a522 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:25.574370 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-57cd245e-951e-4826-bbc7-1312ca37a522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:25.694280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd245e-951e-4826-bbc7-1312ca37a522 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:25.706845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab06d5-6cc7-4e94-abd6-56ed14515e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:25.707523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab06d5-6cc7-4e94-abd6-56ed14515e2d service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:25.707808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab06d5-6cc7-4e94-abd6-56ed14515e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:25.708091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab06d5-6cc7-4e94-abd6-56ed14515e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:25.736207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab06d5-6cc7-4e94-abd6-56ed14515e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:25.737960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab06d5-6cc7-4e94-abd6-56ed14515e2d service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:25.763245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 726/1451] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:25.872011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aa065-62f0-46e3-b97a-1c1cb9032ba5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:25.873802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-db6aa065-62f0-46e3-b97a-1c1cb9032ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:25.918003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab06d5-6cc7-4e94-abd6-56ed14515e2d service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:25.926017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aa065-62f0-46e3-b97a-1c1cb9032ba5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:25.940799 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab06d5-6cc7-4e94-abd6-56ed14515e2d service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:25.946858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f12658-06d9-44ce-b802-6d34e2238077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:25.947652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f12658-06d9-44ce-b802-6d34e2238077 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:25.948045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f12658-06d9-44ce-b802-6d34e2238077 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:25.948425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f12658-06d9-44ce-b802-6d34e2238077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:25.964004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:25.964890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:25.965349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:25.965742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] PATH_INFO: `/v3/users/4e55bec3a0c44a18bc176819c474e751` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:25.972365 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e55bec3a0c44a18bc176819c474e751)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:25.976845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:25.979546 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f12658-06d9-44ce-b802-6d34e2238077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:25.981308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f12658-06d9-44ce-b802-6d34e2238077 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:26.017168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 726/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:26.100064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e55bec3a0c44a18bc176819c474e751'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:26.101175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e55bec3a0c44a18bc176819c474e751'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:26.123821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e55bec3a0c44a18bc176819c474e751'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:26.142052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e55bec3a0c44a18bc176819c474e751'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:26.144835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-89950085-3f1d-4709-b2bc-468d20e3ba9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e55bec3a0c44a18bc176819c474e751'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:26.190732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f12658-06d9-44ce-b802-6d34e2238077 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:26.191739 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 727/1453] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:25 2022] DELETE /identity/v3/users/4e55bec3a0c44a18bc176819c474e751 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:26.197739 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54042-1c48-4043-9d91-74c5b924b0ca None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:26.201332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54042-1c48-4043-9d91-74c5b924b0ca None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:26.201750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54042-1c48-4043-9d91-74c5b924b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:26.207523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f12658-06d9-44ce-b802-6d34e2238077 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:26.233559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c6a54042-1c48-4043-9d91-74c5b924b0ca None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:26.235791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c6a54042-1c48-4043-9d91-74c5b924b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:26.337227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcfd3d-1e68-4d73-b54e-7e96dad95a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:26.338170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcfd3d-1e68-4d73-b54e-7e96dad95a4b service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:26.339305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcfd3d-1e68-4d73-b54e-7e96dad95a4b service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:26.339305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcfd3d-1e68-4d73-b54e-7e96dad95a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:26.347312 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4cdcfd3d-1e68-4d73-b54e-7e96dad95a4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:26.402787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:26.413653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:26.454751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 728/1454] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:26.465808 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcfd3d-1e68-4d73-b54e-7e96dad95a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:26.467795 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcfd3d-1e68-4d73-b54e-7e96dad95a4b service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:26.480721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 727/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:26.550470 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a54042-1c48-4043-9d91-74c5b924b0ca None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:26.554481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c6a54042-1c48-4043-9d91-74c5b924b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:26.580320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a54042-1c48-4043-9d91-74c5b924b0ca None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:26.592624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:26.593454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:26.593749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:26.594208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] PATH_INFO: `/v3/projects/39e62d3fc29c4c46a59e03874acc1b89` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:26.595623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e62d3fc29c4c46a59e03874acc1b89)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:26.600515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:26.622499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcfd3d-1e68-4d73-b54e-7e96dad95a4b service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:26.624360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4cdcfd3d-1e68-4d73-b54e-7e96dad95a4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:26.769580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e62d3fc29c4c46a59e03874acc1b89', 'request_id': 'req-bbae281d-b4f1-46af-84ba-793a9a11e81e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:26.811707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e62d3fc29c4c46a59e03874acc1b89', 'request_id': 'req-bbae281d-b4f1-46af-84ba-793a9a11e81e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:26.856026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e62d3fc29c4c46a59e03874acc1b89', 'request_id': 'req-bbae281d-b4f1-46af-84ba-793a9a11e81e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:26.863466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcfd3d-1e68-4d73-b54e-7e96dad95a4b service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:26.955289 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] The token cache is being invalidate because project 39e62d3fc29c4c46a59e03874acc1b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:26.956245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:26.959958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:26.962101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 729/1456] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:26 2022] DELETE /identity/v3/projects/39e62d3fc29c4c46a59e03874acc1b89 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:26.978813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:26.985645 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:27.117613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae38584-855b-40f1-88b0-aacb2d8aa7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:27.118163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae38584-855b-40f1-88b0-aacb2d8aa7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:27.118446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae38584-855b-40f1-88b0-aacb2d8aa7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:27.118718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae38584-855b-40f1-88b0-aacb2d8aa7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:27.122067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7ae38584-855b-40f1-88b0-aacb2d8aa7a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:27.176089 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae281d-b4f1-46af-84ba-793a9a11e81e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:27.189340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:27.198063 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:27.198357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:27.198638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] PATH_INFO: `/v3/users/6aae1ccc1db84791b037686c63891821` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:27.200388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aae1ccc1db84791b037686c63891821)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:27.202462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:27.305624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae38584-855b-40f1-88b0-aacb2d8aa7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:27.307577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae38584-855b-40f1-88b0-aacb2d8aa7a5 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:27.328563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 728/1457] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:27.340525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aae1ccc1db84791b037686c63891821'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:27.341415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aae1ccc1db84791b037686c63891821'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:27.353484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aae1ccc1db84791b037686c63891821'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:27.373737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aae1ccc1db84791b037686c63891821'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:27.374681 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aae1ccc1db84791b037686c63891821'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:27.398317 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:27.432552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 730/1458] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:26 2022] DELETE /identity/v3/users/6aae1ccc1db84791b037686c63891821 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:28.502739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa427fc-fd66-41af-8e7f-70cd0e5703a3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:28.505216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa427fc-fd66-41af-8e7f-70cd0e5703a3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:28.505521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa427fc-fd66-41af-8e7f-70cd0e5703a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:28.580706 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ffa427fc-fd66-41af-8e7f-70cd0e5703a3 None None] MFA Rules not processed for user `f9558205f6b449e6b322455e288852fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:28.581953 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ffa427fc-fd66-41af-8e7f-70cd0e5703a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:28.636430 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:28.796025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 729/1459] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:28.797809 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:28.799443 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:28.969278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8890-0a97-414f-8fbc-cfd8d3cf16b3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:28.969583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8890-0a97-414f-8fbc-cfd8d3cf16b3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:28.970244 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8890-0a97-414f-8fbc-cfd8d3cf16b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:28.979439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24057-090c-4798-a05d-2b6974b389b2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:28.987877 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0834a-5d8c-498c-94f9-59d01a6cdcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:28.990208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0834a-5d8c-498c-94f9-59d01a6cdcfa admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:28.990589 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0834a-5d8c-498c-94f9-59d01a6cdcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:28.990933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0834a-5d8c-498c-94f9-59d01a6cdcfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:28.991806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0834a-5d8c-498c-94f9-59d01a6cdcfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:28.994793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0834a-5d8c-498c-94f9-59d01a6cdcfa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:29.028254 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e82b8890-0a97-414f-8fbc-cfd8d3cf16b3 None None] MFA Rules not processed for user `78ca6fbbda31433bbe598ce667103cae`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:29.032185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e82b8890-0a97-414f-8fbc-cfd8d3cf16b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:29.067206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 731/1460] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:28 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:29.074735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0834a-5d8c-498c-94f9-59d01a6cdcfa admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:29.227617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0834a-5d8c-498c-94f9-59d01a6cdcfa admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:29.253376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 730/1461] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:29.254857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb6293-cd8f-4668-accd-031d949df89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:29.256228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb6293-cd8f-4668-accd-031d949df89c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:29.257058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb6293-cd8f-4668-accd-031d949df89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:29.257644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb6293-cd8f-4668-accd-031d949df89c admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:29.258486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb6293-cd8f-4668-accd-031d949df89c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:29.261264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb6293-cd8f-4668-accd-031d949df89c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:29.270227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7899d25-5458-4971-87db-67118e243aa6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:29.272330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7899d25-5458-4971-87db-67118e243aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:29.272953 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7899d25-5458-4971-87db-67118e243aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:29.314538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d7899d25-5458-4971-87db-67118e243aa6 None None] MFA Rules not processed for user `71e75366f8b44eb1a0af9d7f8498c7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:29.315992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d7899d25-5458-4971-87db-67118e243aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:29.335929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 732/1462] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:29 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:29.347408 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb6293-cd8f-4668-accd-031d949df89c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:29.373908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb6293-cd8f-4668-accd-031d949df89c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:29.413643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d47ac-6b29-47a0-b811-9862fc8ccaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:29.414358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d47ac-6b29-47a0-b811-9862fc8ccaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:29.414644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d47ac-6b29-47a0-b811-9862fc8ccaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:29.414944 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d47ac-6b29-47a0-b811-9862fc8ccaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:29.415705 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d47ac-6b29-47a0-b811-9862fc8ccaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:29.425720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d47ac-6b29-47a0-b811-9862fc8ccaf0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:29.449074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 733/1463] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:34:29.450010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d47ac-6b29-47a0-b811-9862fc8ccaf0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:29.456312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-654d47ac-6b29-47a0-b811-9862fc8ccaf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:29.478426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 731/1464] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:29.483428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7899d25-5458-4971-87db-67118e243aa6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:29.487033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d7899d25-5458-4971-87db-67118e243aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:29.505494 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d47ac-6b29-47a0-b811-9862fc8ccaf0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:29.509613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7899d25-5458-4971-87db-67118e243aa6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:29.518174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:29.519194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:29.519862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:29.521733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] PATH_INFO: `/v3/projects/5147f2ebbaaa4104bb0441a912a5dcb8` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:29.543567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:29.544498 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5147f2ebbaaa4104bb0441a912a5dcb8)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:29.546009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:29.546371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:29.546940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] PATH_INFO: `/v3/projects/be54a5d418204b8aaa34d1e0fc1b160c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:29.552247 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be54a5d418204b8aaa34d1e0fc1b160c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:29.556140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:29.564833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:29.642928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5147f2ebbaaa4104bb0441a912a5dcb8', 'request_id': 'req-c1defccc-c4fb-423d-bac2-18f728488dc3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:29.653235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5147f2ebbaaa4104bb0441a912a5dcb8', 'request_id': 'req-c1defccc-c4fb-423d-bac2-18f728488dc3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:29.663664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5147f2ebbaaa4104bb0441a912a5dcb8', 'request_id': 'req-c1defccc-c4fb-423d-bac2-18f728488dc3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:29.667785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:29.684862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] The token cache is being invalidate because project 5147f2ebbaaa4104bb0441a912a5dcb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:29.685768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:29.687246 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:29.693107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 732/1465] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:29 2022] DELETE /identity/v3/projects/5147f2ebbaaa4104bb0441a912a5dcb8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:29.693107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:29.693943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:29.720874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:29.725429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be54a5d418204b8aaa34d1e0fc1b160c', 'request_id': 'req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:29.748278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be54a5d418204b8aaa34d1e0fc1b160c', 'request_id': 'req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:29.764118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be54a5d418204b8aaa34d1e0fc1b160c', 'request_id': 'req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:29.796250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] The token cache is being invalidate because project be54a5d418204b8aaa34d1e0fc1b160c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:29.796882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:29.799554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1e5a56f-5551-46bd-8bf4-b9aab54a0aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:29.820405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 734/1466] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:29 2022] DELETE /identity/v3/projects/be54a5d418204b8aaa34d1e0fc1b160c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:29.822134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af9d75-0a17-4620-a6a5-0f0bfe77e3ff None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:29.827265 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af9d75-0a17-4620-a6a5-0f0bfe77e3ff None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:29.829006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af9d75-0a17-4620-a6a5-0f0bfe77e3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:29.892074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-09af9d75-0a17-4620-a6a5-0f0bfe77e3ff None None] MFA Rules not processed for user `cbdfd88ab0f448e48e86379efa48a8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:29.893375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-09af9d75-0a17-4620-a6a5-0f0bfe77e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:30.029294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 735/1467] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:30.030838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafdf24-56d5-40f1-9fd0-32af2dc61ab1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:30.031304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafdf24-56d5-40f1-9fd0-32af2dc61ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:30.031730 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafdf24-56d5-40f1-9fd0-32af2dc61ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:30.060439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ffafdf24-56d5-40f1-9fd0-32af2dc61ab1 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:30.062029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ffafdf24-56d5-40f1-9fd0-32af2dc61ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:30.089877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1defccc-c4fb-423d-bac2-18f728488dc3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:30.172074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 736/1468] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:30.182125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafdf24-56d5-40f1-9fd0-32af2dc61ab1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:30.182125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ffafdf24-56d5-40f1-9fd0-32af2dc61ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:30.215723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafdf24-56d5-40f1-9fd0-32af2dc61ab1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:30.230389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:30.231048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:30.231333 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:30.231610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] PATH_INFO: `/v3/users/0707616ae868470eb141b97e679c956d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:30.234307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0707616ae868470eb141b97e679c956d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:30.236031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:30.281256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b5248-281f-48c8-8342-3a0cffb6b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:30.281951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b5248-281f-48c8-8342-3a0cffb6b72b admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:30.282234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b5248-281f-48c8-8342-3a0cffb6b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:30.282513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b5248-281f-48c8-8342-3a0cffb6b72b admin admin] PATH_INFO: `/v3/projects/0d8ade5fcd91413a90e84bcbd6c93fb1/users/2f60bdeeeb30404c9c8f457a9085e606/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:30.328973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b5248-281f-48c8-8342-3a0cffb6b72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8ade5fcd91413a90e84bcbd6c93fb1, user_id=2f60bdeeeb30404c9c8f457a9085e606, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:30.368376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b5248-281f-48c8-8342-3a0cffb6b72b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:30.412096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0707616ae868470eb141b97e679c956d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:30.417790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 733/1469] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:29 2022] PUT /identity/v3/projects/0d8ade5fcd91413a90e84bcbd6c93fb1/users/2f60bdeeeb30404c9c8f457a9085e606/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:30.419426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dca01-dfad-444b-96f7-d8fd832f5592 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:30.420911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0707616ae868470eb141b97e679c956d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:30.421357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dca01-dfad-444b-96f7-d8fd832f5592 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:30.422308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dca01-dfad-444b-96f7-d8fd832f5592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:30.444184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0707616ae868470eb141b97e679c956d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:30.460788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0707616ae868470eb141b97e679c956d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:30.461954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0707616ae868470eb141b97e679c956d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:30.476680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c60dca01-dfad-444b-96f7-d8fd832f5592 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:30.480377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c60dca01-dfad-444b-96f7-d8fd832f5592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:30.501337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:30.518386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 737/1470] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:30 2022] DELETE /identity/v3/users/0707616ae868470eb141b97e679c956d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:30.527029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:30.533827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:30.681830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 734/1471] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:30.695226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dca01-dfad-444b-96f7-d8fd832f5592 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:30.713226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dca01-dfad-444b-96f7-d8fd832f5592 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:30.758637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50525-57e2-4c31-9161-dfa7a2fb0eb5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:30.764337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6a22a-84e6-411d-a3aa-048d25f1cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:30.765282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6a22a-84e6-411d-a3aa-048d25f1cff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:30.765735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6a22a-84e6-411d-a3aa-048d25f1cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:30.766299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6a22a-84e6-411d-a3aa-048d25f1cff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:30.767215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6a22a-84e6-411d-a3aa-048d25f1cff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:30.772131 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6a22a-84e6-411d-a3aa-048d25f1cff5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:30.790010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 738/1472] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:30.791522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6a22a-84e6-411d-a3aa-048d25f1cff5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:30.794072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:30.805842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6a22a-84e6-411d-a3aa-048d25f1cff5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:30.823499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf53b2-30d1-4c66-89ef-0297fa0d31f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:30.824210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf53b2-30d1-4c66-89ef-0297fa0d31f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:30.824516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf53b2-30d1-4c66-89ef-0297fa0d31f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:30.824804 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf53b2-30d1-4c66-89ef-0297fa0d31f6 admin admin] PATH_INFO: `/v3/projects/0d8ade5fcd91413a90e84bcbd6c93fb1/users/2f60bdeeeb30404c9c8f457a9085e606/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:30.831994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf53b2-30d1-4c66-89ef-0297fa0d31f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8ade5fcd91413a90e84bcbd6c93fb1, user_id=2f60bdeeeb30404c9c8f457a9085e606, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:30.835389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf53b2-30d1-4c66-89ef-0297fa0d31f6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:30.862201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 739/1473] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:30 2022] PUT /identity/v3/projects/0d8ade5fcd91413a90e84bcbd6c93fb1/users/2f60bdeeeb30404c9c8f457a9085e606/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:30.916834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d46902-69ec-488f-adcf-ebb75c8a3dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:30.917691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46902-69ec-488f-adcf-ebb75c8a3dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:30.918218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46902-69ec-488f-adcf-ebb75c8a3dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:30.918642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46902-69ec-488f-adcf-ebb75c8a3dd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:30.919589 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d46902-69ec-488f-adcf-ebb75c8a3dd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:30.920047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d46902-69ec-488f-adcf-ebb75c8a3dd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:30.922076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d46902-69ec-488f-adcf-ebb75c8a3dd7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:31.001989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 735/1474] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:31.005862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf53b2-30d1-4c66-89ef-0297fa0d31f6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:31.456234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf53b2-30d1-4c66-89ef-0297fa0d31f6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:31.473179 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a206f1c-ff4d-4bfb-9e87-348eea8aa6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:31.475197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a206f1c-ff4d-4bfb-9e87-348eea8aa6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:31.475671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a206f1c-ff4d-4bfb-9e87-348eea8aa6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:31.476712 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a206f1c-ff4d-4bfb-9e87-348eea8aa6e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:31.477388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a206f1c-ff4d-4bfb-9e87-348eea8aa6e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:31.480510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a206f1c-ff4d-4bfb-9e87-348eea8aa6e4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:31.584503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d46902-69ec-488f-adcf-ebb75c8a3dd7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:31.585812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 740/1475] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:31 2022] POST /identity/v3/projects => generated 373 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:31.629444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d46902-69ec-488f-adcf-ebb75c8a3dd7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:31.938548 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404edc-4030-4d12-bb54-ba1a56a78961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:31.943862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404edc-4030-4d12-bb54-ba1a56a78961 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:31.944138 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404edc-4030-4d12-bb54-ba1a56a78961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:31.944413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404edc-4030-4d12-bb54-ba1a56a78961 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:31.945555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8404edc-4030-4d12-bb54-ba1a56a78961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:31.947612 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8404edc-4030-4d12-bb54-ba1a56a78961 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:32.032574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 736/1476] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:31 2022] POST /identity/v3/users => generated 287 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:32.037241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a206f1c-ff4d-4bfb-9e87-348eea8aa6e4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:32.069708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a206f1c-ff4d-4bfb-9e87-348eea8aa6e4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:32.101098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a31be-95e0-4a76-b8d4-e19d715d5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:32.102009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a31be-95e0-4a76-b8d4-e19d715d5442 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:32.102435 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a31be-95e0-4a76-b8d4-e19d715d5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:32.102876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a31be-95e0-4a76-b8d4-e19d715d5442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:32.104066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a31be-95e0-4a76-b8d4-e19d715d5442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:32.105875 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a31be-95e0-4a76-b8d4-e19d715d5442 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:32.144413 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 741/1477] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:32.154148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404edc-4030-4d12-bb54-ba1a56a78961 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:32.173412 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404edc-4030-4d12-bb54-ba1a56a78961 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:32.181515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c39465-98a8-42d3-a9a1-ab941598d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:32.182161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c39465-98a8-42d3-a9a1-ab941598d835 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:32.182437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c39465-98a8-42d3-a9a1-ab941598d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:32.182713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c39465-98a8-42d3-a9a1-ab941598d835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:32.183733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c39465-98a8-42d3-a9a1-ab941598d835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:32.185410 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c39465-98a8-42d3-a9a1-ab941598d835 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:32.215817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 737/1478] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:32.219852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a31be-95e0-4a76-b8d4-e19d715d5442 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:32.236026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a31be-95e0-4a76-b8d4-e19d715d5442 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:32.248151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2783f-0ffd-42c3-97f9-c660fe83e4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:32.249561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2783f-0ffd-42c3-97f9-c660fe83e4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:32.250955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2783f-0ffd-42c3-97f9-c660fe83e4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:32.251781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2783f-0ffd-42c3-97f9-c660fe83e4f2 admin admin] PATH_INFO: `/v3/projects/c294dc67ebc245a89699e1a46d24e2ef/users/407f35d7287d4f63ac73299c8377cf2d/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:32.318473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2783f-0ffd-42c3-97f9-c660fe83e4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c294dc67ebc245a89699e1a46d24e2ef, user_id=407f35d7287d4f63ac73299c8377cf2d, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:32.331779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2783f-0ffd-42c3-97f9-c660fe83e4f2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:32.354127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c39465-98a8-42d3-a9a1-ab941598d835 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:32.355945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-10c39465-98a8-42d3-a9a1-ab941598d835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:32.369841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 742/1479] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:32 2022] PUT /identity/v3/projects/c294dc67ebc245a89699e1a46d24e2ef/users/407f35d7287d4f63ac73299c8377cf2d/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:32.373735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f4a3-6101-4e8f-8375-753307ef7af4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:32.374381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f4a3-6101-4e8f-8375-753307ef7af4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:32.374664 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f4a3-6101-4e8f-8375-753307ef7af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:32.391686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c39465-98a8-42d3-a9a1-ab941598d835 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:32.460953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9043f4a3-6101-4e8f-8375-753307ef7af4 None None] MFA Rules not processed for user `407f35d7287d4f63ac73299c8377cf2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:32.464492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9043f4a3-6101-4e8f-8375-753307ef7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:32.498299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:32.571199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 743/1480] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:32.585604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f4a3-6101-4e8f-8375-753307ef7af4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:32.587758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9043f4a3-6101-4e8f-8375-753307ef7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:32.664003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:32.671732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:32.672121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:32.672892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] PATH_INFO: `/v3/projects/8b312a089b1547fb840dbd4ba01816ac` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:32.674876 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b312a089b1547fb840dbd4ba01816ac)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:32.684797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:32.813515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:32.822335 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f4a3-6101-4e8f-8375-753307ef7af4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:32.830295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b312a089b1547fb840dbd4ba01816ac', 'request_id': 'req-90328df3-e92a-40b3-8942-698edfd5f050'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:32.848632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b312a089b1547fb840dbd4ba01816ac', 'request_id': 'req-90328df3-e92a-40b3-8942-698edfd5f050'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:32.861105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b312a089b1547fb840dbd4ba01816ac', 'request_id': 'req-90328df3-e92a-40b3-8942-698edfd5f050'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:32.894719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] The token cache is being invalidate because project 8b312a089b1547fb840dbd4ba01816ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:32.895019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:32.896521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-90328df3-e92a-40b3-8942-698edfd5f050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:32.905956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 738/1481] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:32 2022] DELETE /identity/v3/projects/8b312a089b1547fb840dbd4ba01816ac => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:32.908991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673c21-cda2-4859-a742-9f8cede0f24f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:32.911851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673c21-cda2-4859-a742-9f8cede0f24f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:32.912214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673c21-cda2-4859-a742-9f8cede0f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:32.957145 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f3d97-f73f-4ded-9de6-acfa9f97291e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:32.957945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f3d97-f73f-4ded-9de6-acfa9f97291e service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:32.958505 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f3d97-f73f-4ded-9de6-acfa9f97291e service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:32.958983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f3d97-f73f-4ded-9de6-acfa9f97291e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:32.961089 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-291f3d97-f73f-4ded-9de6-acfa9f97291e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:32.963378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-91673c21-cda2-4859-a742-9f8cede0f24f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:32.966545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-91673c21-cda2-4859-a742-9f8cede0f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:33.042426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f3d97-f73f-4ded-9de6-acfa9f97291e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:33.043772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f3d97-f73f-4ded-9de6-acfa9f97291e service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:33.067900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 744/1482] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:33.133344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 739/1483] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:33.134697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f40ba-bf9c-4925-a591-f9ef842222f3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:33.135216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f40ba-bf9c-4925-a591-f9ef842222f3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:33.135732 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f40ba-bf9c-4925-a591-f9ef842222f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:33.186758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-574f40ba-bf9c-4925-a591-f9ef842222f3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:33.188553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-574f40ba-bf9c-4925-a591-f9ef842222f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:33.212074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 745/1484] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:33.216287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673c21-cda2-4859-a742-9f8cede0f24f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:33.232759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673c21-cda2-4859-a742-9f8cede0f24f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:33.241983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e5c4-dac8-40d3-97fe-18c5ed897099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:33.242668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e5c4-dac8-40d3-97fe-18c5ed897099 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:33.242949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e5c4-dac8-40d3-97fe-18c5ed897099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:33.243225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e5c4-dac8-40d3-97fe-18c5ed897099 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:33.244001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3e5c4-dac8-40d3-97fe-18c5ed897099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:33.244307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3e5c4-dac8-40d3-97fe-18c5ed897099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:33.246143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3e5c4-dac8-40d3-97fe-18c5ed897099 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:33.287934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 740/1485] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:33.289255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f40ba-bf9c-4925-a591-f9ef842222f3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:33.300165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f40ba-bf9c-4925-a591-f9ef842222f3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:33.320614 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c61e1-0b6b-4bd3-95eb-49382a1f9361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:33.321526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c61e1-0b6b-4bd3-95eb-49382a1f9361 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:33.322040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c61e1-0b6b-4bd3-95eb-49382a1f9361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:33.322540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c61e1-0b6b-4bd3-95eb-49382a1f9361 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:33.323409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c61e1-0b6b-4bd3-95eb-49382a1f9361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:33.326853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c61e1-0b6b-4bd3-95eb-49382a1f9361 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:33.367681 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20023ad7-f4c1-4376-bfe8-66b1e72474d1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:33.368111 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20023ad7-f4c1-4376-bfe8-66b1e72474d1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:33.368375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20023ad7-f4c1-4376-bfe8-66b1e72474d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:33.386864 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:33.412872 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 746/1486] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:33 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:33.413876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c61e1-0b6b-4bd3-95eb-49382a1f9361 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:33.441062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-20023ad7-f4c1-4376-bfe8-66b1e72474d1 None None] MFA Rules not processed for user `2f60bdeeeb30404c9c8f457a9085e606`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:33.443601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-20023ad7-f4c1-4376-bfe8-66b1e72474d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:33.532186 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c61e1-0b6b-4bd3-95eb-49382a1f9361 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:33.561409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76209-42a2-4886-ace3-3a6876ee7ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:33.562203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76209-42a2-4886-ace3-3a6876ee7ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:33.562585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76209-42a2-4886-ace3-3a6876ee7ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:33.562978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76209-42a2-4886-ace3-3a6876ee7ddd admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:33.565764 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d76209-42a2-4886-ace3-3a6876ee7ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:33.573640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d76209-42a2-4886-ace3-3a6876ee7ddd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:33.626174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 741/1487] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:33.630928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05caf4-3a11-4850-8acc-40491c8ed040 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:33.631774 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05caf4-3a11-4850-8acc-40491c8ed040 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:33.631774 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05caf4-3a11-4850-8acc-40491c8ed040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:33.647195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 747/1488] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:33 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:33.662126 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76209-42a2-4886-ace3-3a6876ee7ddd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:33.674659 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-aa05caf4-3a11-4850-8acc-40491c8ed040 None None] MFA Rules not processed for user `f9558205f6b449e6b322455e288852fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:33.675899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-aa05caf4-3a11-4850-8acc-40491c8ed040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:33.682787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76209-42a2-4886-ace3-3a6876ee7ddd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:33.706547 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17461722-a693-4e3b-95a5-2b5835a36bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:33.716699 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17461722-a693-4e3b-95a5-2b5835a36bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:33.717190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17461722-a693-4e3b-95a5-2b5835a36bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:33.717577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17461722-a693-4e3b-95a5-2b5835a36bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:33.718382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17461722-a693-4e3b-95a5-2b5835a36bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:33.720112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17461722-a693-4e3b-95a5-2b5835a36bc5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:33.766440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 748/1489] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:34:33.767584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17461722-a693-4e3b-95a5-2b5835a36bc5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:33.781909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:33.792006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17461722-a693-4e3b-95a5-2b5835a36bc5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:33.821527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167fcf-b8a8-4b72-a4ee-9b6cd94cd345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:33.823842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167fcf-b8a8-4b72-a4ee-9b6cd94cd345 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:33.825963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167fcf-b8a8-4b72-a4ee-9b6cd94cd345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:33.826521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167fcf-b8a8-4b72-a4ee-9b6cd94cd345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:33.827584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03167fcf-b8a8-4b72-a4ee-9b6cd94cd345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:33.830506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03167fcf-b8a8-4b72-a4ee-9b6cd94cd345 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:33.853990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 742/1490] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:33.866303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 749/1491] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:33.870691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05caf4-3a11-4850-8acc-40491c8ed040 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:33.895476 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05caf4-3a11-4850-8acc-40491c8ed040 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:33.922594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f968b-b1d9-4bbd-871e-3046cd87f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:33.923492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f968b-b1d9-4bbd-871e-3046cd87f198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:33.923922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f968b-b1d9-4bbd-871e-3046cd87f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:33.924346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f968b-b1d9-4bbd-871e-3046cd87f198 admin admin] PATH_INFO: `/v3/projects/81f3b464bf4540b2ac5cdf48626f6830/users/9b02b6b13bc945ffb52b69999dbfb5b6/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:33.960854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f968b-b1d9-4bbd-871e-3046cd87f198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f3b464bf4540b2ac5cdf48626f6830, user_id=9b02b6b13bc945ffb52b69999dbfb5b6, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:33.963930 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f968b-b1d9-4bbd-871e-3046cd87f198 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:33.984812 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 743/1492] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:33 2022] PUT /identity/v3/projects/81f3b464bf4540b2ac5cdf48626f6830/users/9b02b6b13bc945ffb52b69999dbfb5b6/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:33.998753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bbd2c-adda-4616-8318-9c538f085249 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:33.999214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bbd2c-adda-4616-8318-9c538f085249 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:33.999643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bbd2c-adda-4616-8318-9c538f085249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:34.035210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-172bbd2c-adda-4616-8318-9c538f085249 None None] MFA Rules not processed for user `9b02b6b13bc945ffb52b69999dbfb5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:34.037615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-172bbd2c-adda-4616-8318-9c538f085249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:34.142227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 750/1493] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:34.143468 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f968b-b1d9-4bbd-871e-3046cd87f198 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:34.245285 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f968b-b1d9-4bbd-871e-3046cd87f198 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:34.253826 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf419b-c476-4be5-9450-82f27e780ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:34.254668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf419b-c476-4be5-9450-82f27e780ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:34.255603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf419b-c476-4be5-9450-82f27e780ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:34.255977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf419b-c476-4be5-9450-82f27e780ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:34.256843 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf419b-c476-4be5-9450-82f27e780ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:34.259112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf419b-c476-4be5-9450-82f27e780ad2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:34.310309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 744/1494] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:34 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:34.311710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bbd2c-adda-4616-8318-9c538f085249 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:34.330136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bbd2c-adda-4616-8318-9c538f085249 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:34.476141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:34.502272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50726ac-ba6f-46af-bac2-4fd976ba5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:34.503144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50726ac-ba6f-46af-bac2-4fd976ba5e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:34.503548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50726ac-ba6f-46af-bac2-4fd976ba5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:34.503926 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50726ac-ba6f-46af-bac2-4fd976ba5e5a admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:34.505082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50726ac-ba6f-46af-bac2-4fd976ba5e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:34.507452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50726ac-ba6f-46af-bac2-4fd976ba5e5a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:34.549613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 751/1495] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:34 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:34.550360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf419b-c476-4be5-9450-82f27e780ad2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:34.565669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf419b-c476-4be5-9450-82f27e780ad2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:34.572882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc729a-58e4-4947-827c-71f68369a5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:34.574008 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc729a-58e4-4947-827c-71f68369a5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:34.574722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc729a-58e4-4947-827c-71f68369a5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:34.575216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc729a-58e4-4947-827c-71f68369a5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:34.576241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc729a-58e4-4947-827c-71f68369a5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:34.579094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc729a-58e4-4947-827c-71f68369a5d3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:34.604917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50726ac-ba6f-46af-bac2-4fd976ba5e5a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:34.626678 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 745/1496] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:34:34.627593 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50726ac-ba6f-46af-bac2-4fd976ba5e5a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:34.634072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c7f88-1f15-4f71-ac34-5b285a812e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:34.635299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c7f88-1f15-4f71-ac34-5b285a812e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:34.635667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c7f88-1f15-4f71-ac34-5b285a812e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:34.636049 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c7f88-1f15-4f71-ac34-5b285a812e2f admin admin] PATH_INFO: `/v3/projects/4043600bdf3745478a51647205729072/users/1fd7f947716545e9aa0d45d85542b480/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:34.658355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c7f88-1f15-4f71-ac34-5b285a812e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4043600bdf3745478a51647205729072, user_id=1fd7f947716545e9aa0d45d85542b480, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:34.662264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c7f88-1f15-4f71-ac34-5b285a812e2f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:34.666523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc729a-58e4-4947-827c-71f68369a5d3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:34.669938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-38fc729a-58e4-4947-827c-71f68369a5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:34.719621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 752/1497] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:34 2022] PUT /identity/v3/projects/4043600bdf3745478a51647205729072/users/1fd7f947716545e9aa0d45d85542b480/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:34.723662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c7f88-1f15-4f71-ac34-5b285a812e2f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:34.950750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c7f88-1f15-4f71-ac34-5b285a812e2f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:34.955037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc729a-58e4-4947-827c-71f68369a5d3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:34.960809 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bbfda-f901-405a-8515-d62fd43cfeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:34.961444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bbfda-f901-405a-8515-d62fd43cfeaa admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:34.961907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bbfda-f901-405a-8515-d62fd43cfeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:34.962192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bbfda-f901-405a-8515-d62fd43cfeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:34.962851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bbfda-f901-405a-8515-d62fd43cfeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:34.966692 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bbfda-f901-405a-8515-d62fd43cfeaa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:35.002987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 753/1498] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:35.003671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bbfda-f901-405a-8515-d62fd43cfeaa admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:35.014132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:35.023848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bbfda-f901-405a-8515-d62fd43cfeaa admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:35.043896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9bbc3-caf9-4e02-abd9-c835aeed34f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:35.045010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9bbc3-caf9-4e02-abd9-c835aeed34f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:35.045010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9bbc3-caf9-4e02-abd9-c835aeed34f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:35.045283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9bbc3-caf9-4e02-abd9-c835aeed34f4 admin admin] PATH_INFO: `/v3/projects/4043600bdf3745478a51647205729072/users/1fd7f947716545e9aa0d45d85542b480/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:35.057259 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9bbc3-caf9-4e02-abd9-c835aeed34f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4043600bdf3745478a51647205729072, user_id=1fd7f947716545e9aa0d45d85542b480, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:35.059961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9bbc3-caf9-4e02-abd9-c835aeed34f4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:35.091467 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 754/1499] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:35 2022] PUT /identity/v3/projects/4043600bdf3745478a51647205729072/users/1fd7f947716545e9aa0d45d85542b480/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:34:35.093201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274476e-e512-419d-939a-303ca48b7f7e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:35.093498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274476e-e512-419d-939a-303ca48b7f7e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:35.093772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274476e-e512-419d-939a-303ca48b7f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:35.159047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5274476e-e512-419d-939a-303ca48b7f7e None None] MFA Rules not processed for user `1fd7f947716545e9aa0d45d85542b480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:35.160480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5274476e-e512-419d-939a-303ca48b7f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:35.165975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e02994-31b9-4323-b8f3-18d6df991b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:35.167192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e02994-31b9-4323-b8f3-18d6df991b72 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:35.167401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e02994-31b9-4323-b8f3-18d6df991b72 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:35.167769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e02994-31b9-4323-b8f3-18d6df991b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:35.173617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-04e02994-31b9-4323-b8f3-18d6df991b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:35.263300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 755/1500] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:35.275758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274476e-e512-419d-939a-303ca48b7f7e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:35.278392 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5274476e-e512-419d-939a-303ca48b7f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:35.294956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e02994-31b9-4323-b8f3-18d6df991b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:35.296836 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e02994-31b9-4323-b8f3-18d6df991b72 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:35.316492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 746/1501] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:35.342491 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:35.391728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274476e-e512-419d-939a-303ca48b7f7e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:35.403099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43c26-909b-430c-99a4-8d1b8897a38b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:35.404018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c26-909b-430c-99a4-8d1b8897a38b service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:35.404580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c26-909b-430c-99a4-8d1b8897a38b service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:35.404871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c26-909b-430c-99a4-8d1b8897a38b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:35.422601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a43c26-909b-430c-99a4-8d1b8897a38b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:35.426337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a43c26-909b-430c-99a4-8d1b8897a38b service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:35.451167 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 756/1502] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:35.580834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2074f6d-f7f4-4c23-9578-f13e545e44f5 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:35.581590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2074f6d-f7f4-4c23-9578-f13e545e44f5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:35.583148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2074f6d-f7f4-4c23-9578-f13e545e44f5 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:35.588780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 747/1503] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:34:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:34:35.601002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5861a-dab2-48cf-8613-fbc6e222747b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:35.601002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5861a-dab2-48cf-8613-fbc6e222747b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:35.601002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5861a-dab2-48cf-8613-fbc6e222747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:35.653402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-20a5861a-dab2-48cf-8613-fbc6e222747b None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:35.655014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-20a5861a-dab2-48cf-8613-fbc6e222747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:35.774464 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2074f6d-f7f4-4c23-9578-f13e545e44f5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:35.837063 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 757/1504] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:34:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:35.919563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2074f6d-f7f4-4c23-9578-f13e545e44f5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:35.927232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:35.928267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:35.928759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:35.929478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] PATH_INFO: `/v3/users/9b02b6b13bc945ffb52b69999dbfb5b6` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:35.930980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b02b6b13bc945ffb52b69999dbfb5b6)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:35.935201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:36.035286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b02b6b13bc945ffb52b69999dbfb5b6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:36.036764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b02b6b13bc945ffb52b69999dbfb5b6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:36.050108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b02b6b13bc945ffb52b69999dbfb5b6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:36.051115 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b02b6b13bc945ffb52b69999dbfb5b6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:36.090111 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b02b6b13bc945ffb52b69999dbfb5b6'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:36.092500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:36.115975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 748/1505] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:35 2022] DELETE /identity/v3/users/9b02b6b13bc945ffb52b69999dbfb5b6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:36.120172 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbc4c-feaa-4404-a597-543c1294424f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:36.120674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbc4c-feaa-4404-a597-543c1294424f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:36.121148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbc4c-feaa-4404-a597-543c1294424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:36.146316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e59dbc4c-feaa-4404-a597-543c1294424f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:36.147727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e59dbc4c-feaa-4404-a597-543c1294424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:36.222568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 758/1506] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:36.269380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:36.271658 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:36.398009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c1da-1765-4440-b3be-194225620d88 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:36.403341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843e45c-f2af-4424-91d3-f177f3a58283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:36.404255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843e45c-f2af-4424-91d3-f177f3a58283 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:36.404718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843e45c-f2af-4424-91d3-f177f3a58283 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:36.405130 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843e45c-f2af-4424-91d3-f177f3a58283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:36.422551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843e45c-f2af-4424-91d3-f177f3a58283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:36.428790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843e45c-f2af-4424-91d3-f177f3a58283 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:36.467349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 749/1507] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:36.958458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dbc4c-feaa-4404-a597-543c1294424f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:36.963687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e59dbc4c-feaa-4404-a597-543c1294424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:37.174533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:37.185222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dbc4c-feaa-4404-a597-543c1294424f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:37.230634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ff500-1521-497b-a662-0ff80be8210a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:37.241305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ff500-1521-497b-a662-0ff80be8210a service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:37.243723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ff500-1521-497b-a662-0ff80be8210a service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:37.245109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ff500-1521-497b-a662-0ff80be8210a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:37.252936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ea9ff500-1521-497b-a662-0ff80be8210a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:37.298675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ff500-1521-497b-a662-0ff80be8210a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:37.309814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ff500-1521-497b-a662-0ff80be8210a service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:37.348548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 759/1508] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:37.452203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843e45c-f2af-4424-91d3-f177f3a58283 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:37.454915 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d843e45c-f2af-4424-91d3-f177f3a58283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:37.471577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843e45c-f2af-4424-91d3-f177f3a58283 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:37.479134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:37.480039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:37.480665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:37.481140 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] PATH_INFO: `/v3/users/407f35d7287d4f63ac73299c8377cf2d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:37.483980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=407f35d7287d4f63ac73299c8377cf2d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:37.488052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:37.614049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407f35d7287d4f63ac73299c8377cf2d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:37.615637 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407f35d7287d4f63ac73299c8377cf2d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:37.629995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407f35d7287d4f63ac73299c8377cf2d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:37.632281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407f35d7287d4f63ac73299c8377cf2d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:37.660494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407f35d7287d4f63ac73299c8377cf2d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:37.688514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 750/1509] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:37 2022] DELETE /identity/v3/users/407f35d7287d4f63ac73299c8377cf2d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:37.691638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918d423-9150-4d94-9150-b1fe6b8d95ca None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:37.691929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918d423-9150-4d94-9150-b1fe6b8d95ca None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:37.692201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918d423-9150-4d94-9150-b1fe6b8d95ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:37.747170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b918d423-9150-4d94-9150-b1fe6b8d95ca None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:37.748502 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b918d423-9150-4d94-9150-b1fe6b8d95ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:37.799620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:37.804052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:38.006543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 760/1510] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:38.077113 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795a741-a32c-4571-85d9-7a0f8d3e7f62 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:38.082818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918d423-9150-4d94-9150-b1fe6b8d95ca None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:38.084799 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b918d423-9150-4d94-9150-b1fe6b8d95ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:38.087021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:38.087618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:38.087906 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:38.089333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] PATH_INFO: `/v3/projects/81f3b464bf4540b2ac5cdf48626f6830` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:38.090735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f3b464bf4540b2ac5cdf48626f6830)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:38.093377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:38.107937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:38.181606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f3b464bf4540b2ac5cdf48626f6830', 'request_id': 'req-1f0e1c28-2c40-439e-a507-74259b441929'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:38.199415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f3b464bf4540b2ac5cdf48626f6830', 'request_id': 'req-1f0e1c28-2c40-439e-a507-74259b441929'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:38.202441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918d423-9150-4d94-9150-b1fe6b8d95ca None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:38.210914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f3b464bf4540b2ac5cdf48626f6830', 'request_id': 'req-1f0e1c28-2c40-439e-a507-74259b441929'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:38.282607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] The token cache is being invalidate because project 81f3b464bf4540b2ac5cdf48626f6830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:38.283226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:38.284168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:38.290038 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 751/1511] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:37 2022] DELETE /identity/v3/projects/81f3b464bf4540b2ac5cdf48626f6830 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:38.296137 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:38.299498 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:38.368736 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9057b20-39ae-4b99-aa6f-f964156f949e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:38.370433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9057b20-39ae-4b99-aa6f-f964156f949e service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:38.371723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9057b20-39ae-4b99-aa6f-f964156f949e service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:38.373249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9057b20-39ae-4b99-aa6f-f964156f949e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:38.383201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f9057b20-39ae-4b99-aa6f-f964156f949e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:38.516443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1c28-2c40-439e-a507-74259b441929 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:38.525989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:38.529123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:38.530037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:38.530144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9057b20-39ae-4b99-aa6f-f964156f949e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:38.531688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:38.534319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] PATH_INFO: `/v3/users/1fd7f947716545e9aa0d45d85542b480` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:38.534973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9057b20-39ae-4b99-aa6f-f964156f949e service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:38.537743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd7f947716545e9aa0d45d85542b480)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:38.539999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:38.557955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 761/1512] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:38.686507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd7f947716545e9aa0d45d85542b480'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:38.687857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd7f947716545e9aa0d45d85542b480'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:38.712130 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd7f947716545e9aa0d45d85542b480'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:38.712622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd7f947716545e9aa0d45d85542b480'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:38.742909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4b7254ad-2426-466d-b83b-3133f80ecb32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd7f947716545e9aa0d45d85542b480'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:38.777398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 752/1513] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:38 2022] DELETE /identity/v3/users/1fd7f947716545e9aa0d45d85542b480 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:39.360531 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cac39-b5ac-4248-8420-8126fe6df64e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:39.361162 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cac39-b5ac-4248-8420-8126fe6df64e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:39.361611 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cac39-b5ac-4248-8420-8126fe6df64e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:39.364382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 762/1514] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:34:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:34:39.399407 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0015bc-73de-4fdf-9e6c-46841a45fece None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:39.400815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0015bc-73de-4fdf-9e6c-46841a45fece None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:39.401188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0015bc-73de-4fdf-9e6c-46841a45fece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:39.430073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cd0015bc-73de-4fdf-9e6c-46841a45fece None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:39.432005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cd0015bc-73de-4fdf-9e6c-46841a45fece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:39.447844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:39.583921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 753/1515] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:34:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:39.892788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cac39-b5ac-4248-8420-8126fe6df64e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:39.895211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f38cac39-b5ac-4248-8420-8126fe6df64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:39.927040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cac39-b5ac-4248-8420-8126fe6df64e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:39.933517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1881a7-7e1b-405b-a0f4-207330467f2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:39.934135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1881a7-7e1b-405b-a0f4-207330467f2f service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:39.934435 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1881a7-7e1b-405b-a0f4-207330467f2f service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:39.934723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1881a7-7e1b-405b-a0f4-207330467f2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:39.944689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1881a7-7e1b-405b-a0f4-207330467f2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:39.946275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1881a7-7e1b-405b-a0f4-207330467f2f service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:39.958534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 763/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:40.877486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0015bc-73de-4fdf-9e6c-46841a45fece None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:40.878901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cd0015bc-73de-4fdf-9e6c-46841a45fece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:40.936661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1881a7-7e1b-405b-a0f4-207330467f2f service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:40.938238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3c1881a7-7e1b-405b-a0f4-207330467f2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:41.038072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0015bc-73de-4fdf-9e6c-46841a45fece None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.052713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.053300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.053583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.053860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] PATH_INFO: `/v3/projects/c294dc67ebc245a89699e1a46d24e2ef` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.055034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c294dc67ebc245a89699e1a46d24e2ef)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.057016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.085566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1881a7-7e1b-405b-a0f4-207330467f2f service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.093278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.094132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.095444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.095876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] PATH_INFO: `/v3/projects/4043600bdf3745478a51647205729072` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.097672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4043600bdf3745478a51647205729072)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.100962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.193698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c294dc67ebc245a89699e1a46d24e2ef', 'request_id': 'req-6a10aecb-c650-41bb-8495-3336b1b6dcf5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:41.206218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c294dc67ebc245a89699e1a46d24e2ef', 'request_id': 'req-6a10aecb-c650-41bb-8495-3336b1b6dcf5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:41.210669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4043600bdf3745478a51647205729072', 'request_id': 'req-a3bea491-56f3-4b85-aa41-f9ba623295f7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:41.219838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4043600bdf3745478a51647205729072', 'request_id': 'req-a3bea491-56f3-4b85-aa41-f9ba623295f7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:41.220523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c294dc67ebc245a89699e1a46d24e2ef', 'request_id': 'req-6a10aecb-c650-41bb-8495-3336b1b6dcf5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:41.233618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4043600bdf3745478a51647205729072', 'request_id': 'req-a3bea491-56f3-4b85-aa41-f9ba623295f7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:41.247210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] The token cache is being invalidate because project c294dc67ebc245a89699e1a46d24e2ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:41.247907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:41.249071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6a10aecb-c650-41bb-8495-3336b1b6dcf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:41.260090 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 754/1517] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:40 2022] DELETE /identity/v3/projects/c294dc67ebc245a89699e1a46d24e2ef => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:41.262122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] The token cache is being invalidate because project 4043600bdf3745478a51647205729072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:41.262822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:41.262923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f595a-2a3f-4b7d-98b4-8ceb6e65f5b8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.263700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f595a-2a3f-4b7d-98b4-8ceb6e65f5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.263700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f595a-2a3f-4b7d-98b4-8ceb6e65f5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.264731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a3bea491-56f3-4b85-aa41-f9ba623295f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:41.267785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 764/1518] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:40 2022] DELETE /identity/v3/projects/4043600bdf3745478a51647205729072 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:41.278026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964c90-2424-424f-82f8-f5334c04afbc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.278372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964c90-2424-424f-82f8-f5334c04afbc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.279124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964c90-2424-424f-82f8-f5334c04afbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.304347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-cd8f595a-2a3f-4b7d-98b4-8ceb6e65f5b8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:41.306119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cd8f595a-2a3f-4b7d-98b4-8ceb6e65f5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:41.315521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a2964c90-2424-424f-82f8-f5334c04afbc None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:41.316813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a2964c90-2424-424f-82f8-f5334c04afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:41.462983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:41.471092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 765/1519] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:41.480373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37822-b8fc-4957-99c8-f651ada05cc1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.480762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37822-b8fc-4957-99c8-f651ada05cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.481728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37822-b8fc-4957-99c8-f651ada05cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.512083 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c3d37822-b8fc-4957-99c8-f651ada05cc1 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:41.513958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c3d37822-b8fc-4957-99c8-f651ada05cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:41.516715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 755/1520] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:41.523799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49230-71e9-49f7-ae6c-32c9266a1d2e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.524888 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49230-71e9-49f7-ae6c-32c9266a1d2e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.525458 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49230-71e9-49f7-ae6c-32c9266a1d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.532369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 766/1521] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:41.537035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d37822-b8fc-4957-99c8-f651ada05cc1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.551252 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-89c49230-71e9-49f7-ae6c-32c9266a1d2e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:41.553378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-89c49230-71e9-49f7-ae6c-32c9266a1d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:41.556301 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d37822-b8fc-4957-99c8-f651ada05cc1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.561875 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5da86b-1725-43db-9a52-efc2a1157e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.563078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da86b-1725-43db-9a52-efc2a1157e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.566488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 756/1522] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:41.567923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da86b-1725-43db-9a52-efc2a1157e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.568431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da86b-1725-43db-9a52-efc2a1157e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.568573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c49230-71e9-49f7-ae6c-32c9266a1d2e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.569548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5da86b-1725-43db-9a52-efc2a1157e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:41.570001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5da86b-1725-43db-9a52-efc2a1157e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.571848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5da86b-1725-43db-9a52-efc2a1157e87 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.574322 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:41.588911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c49230-71e9-49f7-ae6c-32c9266a1d2e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.590782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 767/1523] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:41.595056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5da86b-1725-43db-9a52-efc2a1157e87 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.597214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a2806-68f5-4cd7-9d05-c20311f1f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.597848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a2806-68f5-4cd7-9d05-c20311f1f4ce admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.598130 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a2806-68f5-4cd7-9d05-c20311f1f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.598405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a2806-68f5-4cd7-9d05-c20311f1f4ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.600444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a2806-68f5-4cd7-9d05-c20311f1f4ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:41.600786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a2806-68f5-4cd7-9d05-c20311f1f4ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.602713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a2806-68f5-4cd7-9d05-c20311f1f4ce admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.608082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5da86b-1725-43db-9a52-efc2a1157e87 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.615008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8653df-3dc2-438d-b69a-2abc1688bced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.616010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8653df-3dc2-438d-b69a-2abc1688bced admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.617121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8653df-3dc2-438d-b69a-2abc1688bced admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.617599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8653df-3dc2-438d-b69a-2abc1688bced admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.618836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8653df-3dc2-438d-b69a-2abc1688bced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.626883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 757/1524] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:41.628137 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a2806-68f5-4cd7-9d05-c20311f1f4ce admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.628593 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8653df-3dc2-438d-b69a-2abc1688bced admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.644001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a2806-68f5-4cd7-9d05-c20311f1f4ce admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.652319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f64a1-477b-4984-b5d0-21b6dfc1c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.653150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f64a1-477b-4984-b5d0-21b6dfc1c574 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.653437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f64a1-477b-4984-b5d0-21b6dfc1c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.653716 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f64a1-477b-4984-b5d0-21b6dfc1c574 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.654527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f64a1-477b-4984-b5d0-21b6dfc1c574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.656805 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f64a1-477b-4984-b5d0-21b6dfc1c574 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.674511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 768/1525] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:41 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:41.679717 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8653df-3dc2-438d-b69a-2abc1688bced admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.700320 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 758/1526] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:41 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:41.701357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f64a1-477b-4984-b5d0-21b6dfc1c574 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.778806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f64a1-477b-4984-b5d0-21b6dfc1c574 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.804162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a48ff7-1e76-43a6-a2c9-0a85220b868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.805275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a48ff7-1e76-43a6-a2c9-0a85220b868d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.805593 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a48ff7-1e76-43a6-a2c9-0a85220b868d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.805870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a48ff7-1e76-43a6-a2c9-0a85220b868d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.806882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a48ff7-1e76-43a6-a2c9-0a85220b868d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.809935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a48ff7-1e76-43a6-a2c9-0a85220b868d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.813544 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8653df-3dc2-438d-b69a-2abc1688bced admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.824363 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad945d-c5e1-435f-a5b9-6bf3cc751951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.825192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad945d-c5e1-435f-a5b9-6bf3cc751951 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.826177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad945d-c5e1-435f-a5b9-6bf3cc751951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.826722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad945d-c5e1-435f-a5b9-6bf3cc751951 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.827558 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad945d-c5e1-435f-a5b9-6bf3cc751951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.830121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad945d-c5e1-435f-a5b9-6bf3cc751951 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.838558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 759/1527] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:41 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:41.842466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a48ff7-1e76-43a6-a2c9-0a85220b868d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.856395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a48ff7-1e76-43a6-a2c9-0a85220b868d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.871264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c3c01-0b64-4018-8aef-99aaa6297519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.871900 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c3c01-0b64-4018-8aef-99aaa6297519 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.872182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c3c01-0b64-4018-8aef-99aaa6297519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.872477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c3c01-0b64-4018-8aef-99aaa6297519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.873137 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c3c01-0b64-4018-8aef-99aaa6297519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.874560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 769/1528] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:41 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:41.874835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c3c01-0b64-4018-8aef-99aaa6297519 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.875836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad945d-c5e1-435f-a5b9-6bf3cc751951 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.905090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad945d-c5e1-435f-a5b9-6bf3cc751951 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.905931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 760/1529] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:34:41.907617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c3c01-0b64-4018-8aef-99aaa6297519 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.923286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea936452-02a9-4c78-93cf-be91f48c844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.924082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea936452-02a9-4c78-93cf-be91f48c844e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.924374 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea936452-02a9-4c78-93cf-be91f48c844e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.924732 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea936452-02a9-4c78-93cf-be91f48c844e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.925420 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea936452-02a9-4c78-93cf-be91f48c844e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.928353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea936452-02a9-4c78-93cf-be91f48c844e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.935797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c3c01-0b64-4018-8aef-99aaa6297519 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.949089 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 770/1530] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:41.950923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea936452-02a9-4c78-93cf-be91f48c844e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.953129 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce640996-4ba8-4f22-8783-4120157f08db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.953756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640996-4ba8-4f22-8783-4120157f08db admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.954541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640996-4ba8-4f22-8783-4120157f08db admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.954541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce640996-4ba8-4f22-8783-4120157f08db admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.954944 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce640996-4ba8-4f22-8783-4120157f08db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.959529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce640996-4ba8-4f22-8783-4120157f08db admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.968754 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea936452-02a9-4c78-93cf-be91f48c844e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.974711 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 761/1531] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:41.975930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b5d3-278e-4526-9b9b-da4ef1c0554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:41.976762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b5d3-278e-4526-9b9b-da4ef1c0554e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:41.977185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b5d3-278e-4526-9b9b-da4ef1c0554e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:41.977869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b5d3-278e-4526-9b9b-da4ef1c0554e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:41.978606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce640996-4ba8-4f22-8783-4120157f08db admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:41.978981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3b5d3-278e-4526-9b9b-da4ef1c0554e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:41.981063 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3b5d3-278e-4526-9b9b-da4ef1c0554e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:41.990934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce640996-4ba8-4f22-8783-4120157f08db admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:41.993882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 771/1532] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:41.997964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b5d3-278e-4526-9b9b-da4ef1c0554e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.007145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c897cc7-2519-4c52-be86-0c81abbaa962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.007929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c897cc7-2519-4c52-be86-0c81abbaa962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.008277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c897cc7-2519-4c52-be86-0c81abbaa962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.008653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c897cc7-2519-4c52-be86-0c81abbaa962 admin admin] PATH_INFO: `/v3/projects/34b181fcddcf4d78b35485cd09b162fe/users/5031e770722a4f3286f575e3f5409551/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.017821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b5d3-278e-4526-9b9b-da4ef1c0554e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.028906 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c897cc7-2519-4c52-be86-0c81abbaa962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b181fcddcf4d78b35485cd09b162fe, user_id=5031e770722a4f3286f575e3f5409551, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.032005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c897cc7-2519-4c52-be86-0c81abbaa962 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.044772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50293a8-af2e-46a9-9aa3-bcdfc7df8179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.045857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50293a8-af2e-46a9-9aa3-bcdfc7df8179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.047405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 762/1533] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:41 2022] PUT /identity/v3/projects/34b181fcddcf4d78b35485cd09b162fe/users/5031e770722a4f3286f575e3f5409551/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:34:42.048383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50293a8-af2e-46a9-9aa3-bcdfc7df8179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.050552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50293a8-af2e-46a9-9aa3-bcdfc7df8179 admin admin] PATH_INFO: `/v3/projects/9e1ed511e0d94d76bdb4182f35b47dad/users/77719ca1f09e497faee52fcbc8a5f996/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.059044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c0211-9d2d-483b-9c45-2a8cc54e72a2 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.059150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c0211-9d2d-483b-9c45-2a8cc54e72a2 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.059423 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c0211-9d2d-483b-9c45-2a8cc54e72a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.073829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50293a8-af2e-46a9-9aa3-bcdfc7df8179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1ed511e0d94d76bdb4182f35b47dad, user_id=77719ca1f09e497faee52fcbc8a5f996, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.076177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50293a8-af2e-46a9-9aa3-bcdfc7df8179 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.091635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c92c0211-9d2d-483b-9c45-2a8cc54e72a2 None None] MFA Rules not processed for user `5031e770722a4f3286f575e3f5409551`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:42.092917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 772/1534] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:41 2022] PUT /identity/v3/projects/9e1ed511e0d94d76bdb4182f35b47dad/users/77719ca1f09e497faee52fcbc8a5f996/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:34:42.093034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c92c0211-9d2d-483b-9c45-2a8cc54e72a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:42.103366 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5f647-6bd4-4ed2-adb7-5cc23d2e7534 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.103648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5f647-6bd4-4ed2-adb7-5cc23d2e7534 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.104105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5f647-6bd4-4ed2-adb7-5cc23d2e7534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.131449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:42.136881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2cb5f647-6bd4-4ed2-adb7-5cc23d2e7534 None None] MFA Rules not processed for user `77719ca1f09e497faee52fcbc8a5f996`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:42.138646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2cb5f647-6bd4-4ed2-adb7-5cc23d2e7534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:42.170468 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 763/1535] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:42.175000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c0211-9d2d-483b-9c45-2a8cc54e72a2 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.203889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 773/1536] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:42.208701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5f647-6bd4-4ed2-adb7-5cc23d2e7534 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.215058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:42.238922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c0211-9d2d-483b-9c45-2a8cc54e72a2 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.243594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592bc03-78e5-4a6c-ba82-3005d4e287b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.244202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592bc03-78e5-4a6c-ba82-3005d4e287b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.244515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592bc03-78e5-4a6c-ba82-3005d4e287b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.244901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592bc03-78e5-4a6c-ba82-3005d4e287b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.245541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592bc03-78e5-4a6c-ba82-3005d4e287b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.247436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592bc03-78e5-4a6c-ba82-3005d4e287b5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.275427 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 764/1537] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:42 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:42.277940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5f647-6bd4-4ed2-adb7-5cc23d2e7534 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.279471 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592bc03-78e5-4a6c-ba82-3005d4e287b5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.336249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9034d-07b9-4b38-8c26-b112b788e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.336900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9034d-07b9-4b38-8c26-b112b788e5ae admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.337181 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9034d-07b9-4b38-8c26-b112b788e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.337453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9034d-07b9-4b38-8c26-b112b788e5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.338083 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9034d-07b9-4b38-8c26-b112b788e5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.340005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9034d-07b9-4b38-8c26-b112b788e5ae admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.344278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592bc03-78e5-4a6c-ba82-3005d4e287b5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.350860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8218c1a-3a37-4f65-8170-aa0827ded407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.351080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8218c1a-3a37-4f65-8170-aa0827ded407 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.351366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8218c1a-3a37-4f65-8170-aa0827ded407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.351639 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8218c1a-3a37-4f65-8170-aa0827ded407 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.352274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8218c1a-3a37-4f65-8170-aa0827ded407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.354281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8218c1a-3a37-4f65-8170-aa0827ded407 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.370095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 774/1538] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:42 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:42.374207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9034d-07b9-4b38-8c26-b112b788e5ae admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.388756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 765/1539] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:42 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:42.389846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8218c1a-3a37-4f65-8170-aa0827ded407 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.403629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8218c1a-3a37-4f65-8170-aa0827ded407 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.446613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9034d-07b9-4b38-8c26-b112b788e5ae admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.451680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30ea16-864c-48e6-b639-8f3aa6809877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.452359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30ea16-864c-48e6-b639-8f3aa6809877 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.452729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30ea16-864c-48e6-b639-8f3aa6809877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.453180 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30ea16-864c-48e6-b639-8f3aa6809877 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.453879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30ea16-864c-48e6-b639-8f3aa6809877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.455931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30ea16-864c-48e6-b639-8f3aa6809877 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.457347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:42.479659 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc967-3a85-48f5-bfed-21c6c98628e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.480289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc967-3a85-48f5-bfed-21c6c98628e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.480695 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc967-3a85-48f5-bfed-21c6c98628e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.480980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc967-3a85-48f5-bfed-21c6c98628e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.481634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afc967-3a85-48f5-bfed-21c6c98628e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.483494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afc967-3a85-48f5-bfed-21c6c98628e9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.485484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 775/1540] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:42 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:42.486541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30ea16-864c-48e6-b639-8f3aa6809877 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.496591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 766/1541] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:42.501352 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc967-3a85-48f5-bfed-21c6c98628e9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.504101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30ea16-864c-48e6-b639-8f3aa6809877 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.509323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e9f1-00d6-4828-83bb-a64ba7b2ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.509939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e9f1-00d6-4828-83bb-a64ba7b2ed25 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.510218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e9f1-00d6-4828-83bb-a64ba7b2ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.510492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e9f1-00d6-4828-83bb-a64ba7b2ed25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.511635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1e9f1-00d6-4828-83bb-a64ba7b2ed25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.513281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1e9f1-00d6-4828-83bb-a64ba7b2ed25 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.515926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc967-3a85-48f5-bfed-21c6c98628e9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.523560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e6775-0622-40be-ab81-b2557e899560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.524303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e6775-0622-40be-ab81-b2557e899560 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.524712 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e6775-0622-40be-ab81-b2557e899560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.525088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e6775-0622-40be-ab81-b2557e899560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.528510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 776/1542] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:42.528630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e6775-0622-40be-ab81-b2557e899560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.528630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e6775-0622-40be-ab81-b2557e899560 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.529520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e9f1-00d6-4828-83bb-a64ba7b2ed25 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.539718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e9f1-00d6-4828-83bb-a64ba7b2ed25 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.542737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 767/1543] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:42.546490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9e831-a69c-423e-91b7-3bca04cfdb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.547209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e6775-0622-40be-ab81-b2557e899560 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.547349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9e831-a69c-423e-91b7-3bca04cfdb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.547644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9e831-a69c-423e-91b7-3bca04cfdb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.548070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9e831-a69c-423e-91b7-3bca04cfdb8c admin admin] PATH_INFO: `/v3/projects/e770bbb9dec746c7932726436e8ec881/users/5c581b26cf474968b028fc09ce82b0d4/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.557451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e6775-0622-40be-ab81-b2557e899560 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.562265 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236d16c-ad5f-4f8f-980d-592b4e786691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.563026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d16c-ad5f-4f8f-980d-592b4e786691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.563304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d16c-ad5f-4f8f-980d-592b4e786691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.563416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:42.563576 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d16c-ad5f-4f8f-980d-592b4e786691 admin admin] PATH_INFO: `/v3/projects/786a578d494a48f8a164eb97ba4354aa/users/d8351df9a44d462b9f292d96b7af6be2/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.568088 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9e831-a69c-423e-91b7-3bca04cfdb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e770bbb9dec746c7932726436e8ec881, user_id=5c581b26cf474968b028fc09ce82b0d4, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.571064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9e831-a69c-423e-91b7-3bca04cfdb8c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.584072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236d16c-ad5f-4f8f-980d-592b4e786691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786a578d494a48f8a164eb97ba4354aa, user_id=d8351df9a44d462b9f292d96b7af6be2, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.587401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236d16c-ad5f-4f8f-980d-592b4e786691 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.593340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 777/1544] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:42 2022] PUT /identity/v3/projects/e770bbb9dec746c7932726436e8ec881/users/5c581b26cf474968b028fc09ce82b0d4/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:42.599387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9e831-a69c-423e-91b7-3bca04cfdb8c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.606154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 768/1545] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:42 2022] PUT /identity/v3/projects/786a578d494a48f8a164eb97ba4354aa/users/d8351df9a44d462b9f292d96b7af6be2/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:34:42.618519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9646-3e06-489a-8f28-13f639b5b4e3 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.618519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9646-3e06-489a-8f28-13f639b5b4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.618819 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9646-3e06-489a-8f28-13f639b5b4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.650326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8cfd9646-3e06-489a-8f28-13f639b5b4e3 None None] MFA Rules not processed for user `d8351df9a44d462b9f292d96b7af6be2`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:42.651657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8cfd9646-3e06-489a-8f28-13f639b5b4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:42.702100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9e831-a69c-423e-91b7-3bca04cfdb8c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.737157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 769/1546] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:42.742754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd9646-3e06-489a-8f28-13f639b5b4e3 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.759732 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e08db-d076-4934-a906-00889c6f462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.760343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e08db-d076-4934-a906-00889c6f462a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.760651 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e08db-d076-4934-a906-00889c6f462a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.760918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e08db-d076-4934-a906-00889c6f462a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.761579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e08db-d076-4934-a906-00889c6f462a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.763175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e08db-d076-4934-a906-00889c6f462a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.774715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 778/1547] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:34:42.778663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e08db-d076-4934-a906-00889c6f462a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.789237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e08db-d076-4934-a906-00889c6f462a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.795258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a262397-cfe8-4db0-9129-84bdf337625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.796047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a262397-cfe8-4db0-9129-84bdf337625f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.796336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a262397-cfe8-4db0-9129-84bdf337625f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.796665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a262397-cfe8-4db0-9129-84bdf337625f admin admin] PATH_INFO: `/v3/projects/e770bbb9dec746c7932726436e8ec881/users/5c581b26cf474968b028fc09ce82b0d4/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.798688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a262397-cfe8-4db0-9129-84bdf337625f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e770bbb9dec746c7932726436e8ec881, user_id=5c581b26cf474968b028fc09ce82b0d4, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.801556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a262397-cfe8-4db0-9129-84bdf337625f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.812570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd9646-3e06-489a-8f28-13f639b5b4e3 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:42.814452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 779/1548] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:42 2022] PUT /identity/v3/projects/e770bbb9dec746c7932726436e8ec881/users/5c581b26cf474968b028fc09ce82b0d4/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:34:42.825496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de915b2-a5a6-4725-abf6-fd5c3402ff40 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.825783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de915b2-a5a6-4725-abf6-fd5c3402ff40 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.826065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de915b2-a5a6-4725-abf6-fd5c3402ff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.855791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1de915b2-a5a6-4725-abf6-fd5c3402ff40 None None] MFA Rules not processed for user `5c581b26cf474968b028fc09ce82b0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:42.857037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1de915b2-a5a6-4725-abf6-fd5c3402ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:42.860413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:42.879116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df3de-983e-402f-8375-28e7ec7b102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:42.880288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df3de-983e-402f-8375-28e7ec7b102a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:42.880850 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df3de-983e-402f-8375-28e7ec7b102a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:42.881206 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df3de-983e-402f-8375-28e7ec7b102a admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:42.882212 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8df3de-983e-402f-8375-28e7ec7b102a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:42.884187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8df3de-983e-402f-8375-28e7ec7b102a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:42.915036 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 770/1549] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:42 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:42.921831 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df3de-983e-402f-8375-28e7ec7b102a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.950847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 780/1550] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:42.962655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de915b2-a5a6-4725-abf6-fd5c3402ff40 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:42.963712 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1de915b2-a5a6-4725-abf6-fd5c3402ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:42.978121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:43.006878 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df3de-983e-402f-8375-28e7ec7b102a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:43.012069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d818d-517e-435b-9c09-a99ef7ee653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:43.012850 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d818d-517e-435b-9c09-a99ef7ee653f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:43.013407 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d818d-517e-435b-9c09-a99ef7ee653f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:43.013785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d818d-517e-435b-9c09-a99ef7ee653f admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:43.015079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d818d-517e-435b-9c09-a99ef7ee653f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:43.017125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d818d-517e-435b-9c09-a99ef7ee653f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:43.047991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 771/1551] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:42 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:43.052758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d818d-517e-435b-9c09-a99ef7ee653f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:43.064559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de915b2-a5a6-4725-abf6-fd5c3402ff40 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:43.065677 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d818d-517e-435b-9c09-a99ef7ee653f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:43.071130 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9ffa0-b50d-4096-8058-12ac0bb45212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:43.072164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ffa0-b50d-4096-8058-12ac0bb45212 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:43.072164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ffa0-b50d-4096-8058-12ac0bb45212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:43.072377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ffa0-b50d-4096-8058-12ac0bb45212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:43.074150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9ffa0-b50d-4096-8058-12ac0bb45212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:43.076189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9ffa0-b50d-4096-8058-12ac0bb45212 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:43.088543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 772/1552] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:43.094037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9ffa0-b50d-4096-8058-12ac0bb45212 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:43.106105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9ffa0-b50d-4096-8058-12ac0bb45212 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:43.113198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e72d46-3717-4032-9372-14abc019c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:43.114301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e72d46-3717-4032-9372-14abc019c16f admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:43.114301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e72d46-3717-4032-9372-14abc019c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:43.114470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e72d46-3717-4032-9372-14abc019c16f admin admin] PATH_INFO: `/v3/projects/7f4d48b1084b4fcfa0a300f66a56d16b/users/5eecc813fba54921a542d4960671de5d/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:43.129836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66fd64-11da-4e98-a0bf-621f35ddedb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:43.130474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66fd64-11da-4e98-a0bf-621f35ddedb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:43.130789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66fd64-11da-4e98-a0bf-621f35ddedb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:43.131018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66fd64-11da-4e98-a0bf-621f35ddedb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:43.131576 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e72d46-3717-4032-9372-14abc019c16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4d48b1084b4fcfa0a300f66a56d16b, user_id=5eecc813fba54921a542d4960671de5d, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:43.134300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e72d46-3717-4032-9372-14abc019c16f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:43.151653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 773/1553] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:43 2022] PUT /identity/v3/projects/7f4d48b1084b4fcfa0a300f66a56d16b/users/5eecc813fba54921a542d4960671de5d/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:43.155816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e72d46-3717-4032-9372-14abc019c16f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:43.214042 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66fd64-11da-4e98-a0bf-621f35ddedb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:43.214916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66fd64-11da-4e98-a0bf-621f35ddedb2 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:43.232888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 781/1554] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:43.270984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e72d46-3717-4032-9372-14abc019c16f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:43.276860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc760e17-7d35-4746-b65b-40e1f66fab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:43.277852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760e17-7d35-4746-b65b-40e1f66fab7c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:43.278370 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760e17-7d35-4746-b65b-40e1f66fab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:43.285204 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760e17-7d35-4746-b65b-40e1f66fab7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:43.286863 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc760e17-7d35-4746-b65b-40e1f66fab7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:43.289454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc760e17-7d35-4746-b65b-40e1f66fab7c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:43.319758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 774/1555] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:43.323576 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66fd64-11da-4e98-a0bf-621f35ddedb2 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:43.343316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66fd64-11da-4e98-a0bf-621f35ddedb2 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:43.366411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186148f-dea3-4a0b-a424-7cdc556b7858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:43.369557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186148f-dea3-4a0b-a424-7cdc556b7858 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:43.373429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186148f-dea3-4a0b-a424-7cdc556b7858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:43.373429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186148f-dea3-4a0b-a424-7cdc556b7858 admin admin] PATH_INFO: `/v3/projects/7f4d48b1084b4fcfa0a300f66a56d16b/users/5eecc813fba54921a542d4960671de5d/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:43.380910 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186148f-dea3-4a0b-a424-7cdc556b7858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4d48b1084b4fcfa0a300f66a56d16b, user_id=5eecc813fba54921a542d4960671de5d, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:43.386910 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186148f-dea3-4a0b-a424-7cdc556b7858 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:43.419200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 782/1556] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:43 2022] PUT /identity/v3/projects/7f4d48b1084b4fcfa0a300f66a56d16b/users/5eecc813fba54921a542d4960671de5d/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:43.430450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec4463-42a4-4f62-9330-05fb5203b0dc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:43.431578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec4463-42a4-4f62-9330-05fb5203b0dc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:43.431809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec4463-42a4-4f62-9330-05fb5203b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:43.477764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8dec4463-42a4-4f62-9330-05fb5203b0dc None None] MFA Rules not processed for user `5eecc813fba54921a542d4960671de5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:43.479182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8dec4463-42a4-4f62-9330-05fb5203b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:43.485750 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:43.580966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 775/1557] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:43.593922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186148f-dea3-4a0b-a424-7cdc556b7858 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:43.595644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f186148f-dea3-4a0b-a424-7cdc556b7858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:43.701179 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186148f-dea3-4a0b-a424-7cdc556b7858 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:43.708387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcd844-57b9-468c-802d-87ad1317e400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:43.713464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd844-57b9-468c-802d-87ad1317e400 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:43.714010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd844-57b9-468c-802d-87ad1317e400 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:43.714509 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd844-57b9-468c-802d-87ad1317e400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:43.734453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:43.835202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcd844-57b9-468c-802d-87ad1317e400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:43.836871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcd844-57b9-468c-802d-87ad1317e400 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:43.839523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec4463-42a4-4f62-9330-05fb5203b0dc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:43.855707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 783/1558] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:43.954005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec4463-42a4-4f62-9330-05fb5203b0dc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:43.960541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:43.961684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:43.962270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:43.962737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] PATH_INFO: `/v3/users/77719ca1f09e497faee52fcbc8a5f996` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:43.964095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77719ca1f09e497faee52fcbc8a5f996)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:43.967228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:44.071612 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77719ca1f09e497faee52fcbc8a5f996'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:44.073402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77719ca1f09e497faee52fcbc8a5f996'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:44.084514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77719ca1f09e497faee52fcbc8a5f996'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:44.085369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77719ca1f09e497faee52fcbc8a5f996'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:44.101296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77719ca1f09e497faee52fcbc8a5f996'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:44.129463 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 776/1559] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:43 2022] DELETE /identity/v3/users/77719ca1f09e497faee52fcbc8a5f996 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:34:44.134890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a0e2-264b-4f67-8e76-2285c0bd2e93 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:44.135802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a0e2-264b-4f67-8e76-2285c0bd2e93 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:44.136218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a0e2-264b-4f67-8e76-2285c0bd2e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:44.169078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6e45a0e2-264b-4f67-8e76-2285c0bd2e93 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:44.189836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6e45a0e2-264b-4f67-8e76-2285c0bd2e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:44.354196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 784/1560] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:44.375310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:44.376954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:44.422349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:44.474714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a6a72-4046-4dd8-93a8-2a5e7e75513e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:44.479654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2901b06-a8b4-45e0-8af9-61c1e496f032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:44.480905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2901b06-a8b4-45e0-8af9-61c1e496f032 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:44.481314 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2901b06-a8b4-45e0-8af9-61c1e496f032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:44.481871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2901b06-a8b4-45e0-8af9-61c1e496f032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:44.499619 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2901b06-a8b4-45e0-8af9-61c1e496f032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:44.501406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2901b06-a8b4-45e0-8af9-61c1e496f032 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:44.514840 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 777/1561] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:44.943103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a0e2-264b-4f67-8e76-2285c0bd2e93 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:44.945618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6e45a0e2-264b-4f67-8e76-2285c0bd2e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:44.965094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a0e2-264b-4f67-8e76-2285c0bd2e93 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:44.971222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:44.971838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:44.972181 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:44.972741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] PATH_INFO: `/v3/projects/9e1ed511e0d94d76bdb4182f35b47dad` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:44.976581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e1ed511e0d94d76bdb4182f35b47dad)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:44.979305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:45.069861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e1ed511e0d94d76bdb4182f35b47dad', 'request_id': 'req-2a608f0d-4e29-418b-b818-ded3194dbe4e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.078875 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e1ed511e0d94d76bdb4182f35b47dad', 'request_id': 'req-2a608f0d-4e29-418b-b818-ded3194dbe4e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.089110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e1ed511e0d94d76bdb4182f35b47dad', 'request_id': 'req-2a608f0d-4e29-418b-b818-ded3194dbe4e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.105711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] The token cache is being invalidate because project 9e1ed511e0d94d76bdb4182f35b47dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:45.105947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.107265 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.108906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 785/1562] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:44 2022] DELETE /identity/v3/projects/9e1ed511e0d94d76bdb4182f35b47dad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:45.113151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2901b06-a8b4-45e0-8af9-61c1e496f032 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:45.125611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2901b06-a8b4-45e0-8af9-61c1e496f032 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:45.190103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:45.190744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:45.191027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:45.191302 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] PATH_INFO: `/v3/users/5c581b26cf474968b028fc09ce82b0d4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:45.192443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c581b26cf474968b028fc09ce82b0d4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:45.194410 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:45.243471 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c581b26cf474968b028fc09ce82b0d4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.244120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c581b26cf474968b028fc09ce82b0d4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.251166 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c581b26cf474968b028fc09ce82b0d4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.251834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c581b26cf474968b028fc09ce82b0d4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.264193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c581b26cf474968b028fc09ce82b0d4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.277426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 778/1563] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:45 2022] DELETE /identity/v3/users/5c581b26cf474968b028fc09ce82b0d4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:45.587006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:45.588584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:45.609122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a608f0d-4e29-418b-b818-ded3194dbe4e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:45.610494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:45.612096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:45.652940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:45.684073 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:45.685078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:45.685194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:45.686026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:45.686732 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] PATH_INFO: `/v3/projects/e770bbb9dec746c7932726436e8ec881` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:45.688593 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e770bbb9dec746c7932726436e8ec881)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:45.690688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:45.712923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2275d33-0ab4-48e3-aaf2-ac36389c4ca3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:45.717260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03fbfd-3d33-40c5-910f-4fc4ac911675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:45.717880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03fbfd-3d33-40c5-910f-4fc4ac911675 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:45.718161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03fbfd-3d33-40c5-910f-4fc4ac911675 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:45.718442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03fbfd-3d33-40c5-910f-4fc4ac911675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:45.723292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1a03fbfd-3d33-40c5-910f-4fc4ac911675 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:45.781695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e770bbb9dec746c7932726436e8ec881', 'request_id': 'req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.796430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e770bbb9dec746c7932726436e8ec881', 'request_id': 'req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.807030 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e770bbb9dec746c7932726436e8ec881', 'request_id': 'req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.813295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03fbfd-3d33-40c5-910f-4fc4ac911675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:45.814842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03fbfd-3d33-40c5-910f-4fc4ac911675 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:45.825920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 779/1564] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:45.839874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] The token cache is being invalidate because project e770bbb9dec746c7932726436e8ec881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:45.840225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.840906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9acd0b8a-9967-4876-a9ca-c901c1c9fe02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:45.843987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 786/1565] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:45 2022] DELETE /identity/v3/projects/e770bbb9dec746c7932726436e8ec881 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:45.848981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44ff86-ccbc-418e-bdc0-c4cb083843c9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:45.849336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44ff86-ccbc-418e-bdc0-c4cb083843c9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:45.852288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44ff86-ccbc-418e-bdc0-c4cb083843c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:45.875200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-db44ff86-ccbc-418e-bdc0-c4cb083843c9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:45.876423 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-db44ff86-ccbc-418e-bdc0-c4cb083843c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:45.957039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 780/1566] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:45.965859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c1030-55e2-422d-8642-ced1d8537729 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:45.966192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c1030-55e2-422d-8642-ced1d8537729 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:45.966589 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c1030-55e2-422d-8642-ced1d8537729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:46.017982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-556c1030-55e2-422d-8642-ced1d8537729 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:46.032689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-556c1030-55e2-422d-8642-ced1d8537729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:46.044770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 787/1567] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:46.055700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44ff86-ccbc-418e-bdc0-c4cb083843c9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:46.071431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44ff86-ccbc-418e-bdc0-c4cb083843c9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:46.077846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc8eb8-160f-4810-9b36-390f1f5ffa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:46.078375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc8eb8-160f-4810-9b36-390f1f5ffa11 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:46.078656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc8eb8-160f-4810-9b36-390f1f5ffa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:46.078919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc8eb8-160f-4810-9b36-390f1f5ffa11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:46.079579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc8eb8-160f-4810-9b36-390f1f5ffa11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:46.079884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc8eb8-160f-4810-9b36-390f1f5ffa11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:46.082389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc8eb8-160f-4810-9b36-390f1f5ffa11 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:46.096666 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 781/1568] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:46.100887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c1030-55e2-422d-8642-ced1d8537729 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:46.114869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c1030-55e2-422d-8642-ced1d8537729 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:46.146363 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6edada-661b-4284-ae58-44f55362a698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:46.149064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6edada-661b-4284-ae58-44f55362a698 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:46.149352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6edada-661b-4284-ae58-44f55362a698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:46.149620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6edada-661b-4284-ae58-44f55362a698 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:46.150269 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6edada-661b-4284-ae58-44f55362a698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:46.153386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6edada-661b-4284-ae58-44f55362a698 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:46.230181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc8eb8-160f-4810-9b36-390f1f5ffa11 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:46.232675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 788/1569] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:46 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:46.243774 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc8eb8-160f-4810-9b36-390f1f5ffa11 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:46.366148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2cf44-36d3-4279-bef2-d5e3e891079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:46.366148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2cf44-36d3-4279-bef2-d5e3e891079a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:46.366148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2cf44-36d3-4279-bef2-d5e3e891079a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:46.366494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2cf44-36d3-4279-bef2-d5e3e891079a admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:46.366975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2cf44-36d3-4279-bef2-d5e3e891079a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:46.371667 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2cf44-36d3-4279-bef2-d5e3e891079a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:46.435085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 782/1570] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:46 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:46.439054 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6edada-661b-4284-ae58-44f55362a698 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:46.452128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6edada-661b-4284-ae58-44f55362a698 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:46.459221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cf4c7-70a2-45f2-acde-32f933fb35b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:46.460030 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cf4c7-70a2-45f2-acde-32f933fb35b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:46.460382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cf4c7-70a2-45f2-acde-32f933fb35b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:46.460814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cf4c7-70a2-45f2-acde-32f933fb35b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:46.461659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cf4c7-70a2-45f2-acde-32f933fb35b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:46.463548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cf4c7-70a2-45f2-acde-32f933fb35b1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:46.476129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 789/1571] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:46.479789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2cf44-36d3-4279-bef2-d5e3e891079a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:46.492230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2cf44-36d3-4279-bef2-d5e3e891079a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:46.498439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3e80a-bdfb-49d5-a5d9-1cac11242ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:46.499267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3e80a-bdfb-49d5-a5d9-1cac11242ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:46.499632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3e80a-bdfb-49d5-a5d9-1cac11242ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:46.500019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3e80a-bdfb-49d5-a5d9-1cac11242ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:46.500986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3e80a-bdfb-49d5-a5d9-1cac11242ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:46.502890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3e80a-bdfb-49d5-a5d9-1cac11242ef0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:46.517196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 783/1572] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:34:46.522296 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cf4c7-70a2-45f2-acde-32f933fb35b1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:46.533936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cf4c7-70a2-45f2-acde-32f933fb35b1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:46.553602 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0e9c4-fb05-4970-a00f-e31348b3315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:46.554505 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0e9c4-fb05-4970-a00f-e31348b3315a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:46.554789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0e9c4-fb05-4970-a00f-e31348b3315a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:46.555068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0e9c4-fb05-4970-a00f-e31348b3315a admin admin] PATH_INFO: `/v3/projects/12c82af25a13411385685b6cf523ee06/users/00a64f01e77a4898a25d32e893754a0d/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:46.594048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0e9c4-fb05-4970-a00f-e31348b3315a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c82af25a13411385685b6cf523ee06, user_id=00a64f01e77a4898a25d32e893754a0d, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:46.597039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0e9c4-fb05-4970-a00f-e31348b3315a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:46.635174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 790/1573] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:46 2022] PUT /identity/v3/projects/12c82af25a13411385685b6cf523ee06/users/00a64f01e77a4898a25d32e893754a0d/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:46.646601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652508f-2c73-419a-827f-cbea4867ba32 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:46.646887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652508f-2c73-419a-827f-cbea4867ba32 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:46.647171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652508f-2c73-419a-827f-cbea4867ba32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:46.671063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:46.727898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e652508f-2c73-419a-827f-cbea4867ba32 None None] MFA Rules not processed for user `00a64f01e77a4898a25d32e893754a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:46.731520 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e652508f-2c73-419a-827f-cbea4867ba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:46.772507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0e9c4-fb05-4970-a00f-e31348b3315a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:46.772507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e9d0e9c4-fb05-4970-a00f-e31348b3315a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:46.897064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 784/1574] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:46.903391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652508f-2c73-419a-827f-cbea4867ba32 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:46.916122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0e9c4-fb05-4970-a00f-e31348b3315a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:46.928902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384c387-802c-4e10-90a6-4d6220b64959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:46.930024 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384c387-802c-4e10-90a6-4d6220b64959 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:46.930520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384c387-802c-4e10-90a6-4d6220b64959 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:46.932054 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384c387-802c-4e10-90a6-4d6220b64959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:46.939916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d384c387-802c-4e10-90a6-4d6220b64959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:46.984914 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:47.072770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652508f-2c73-419a-827f-cbea4867ba32 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:47.087289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb10848-4aec-48d7-9d68-b3c22c149984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:47.087923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb10848-4aec-48d7-9d68-b3c22c149984 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:47.088203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb10848-4aec-48d7-9d68-b3c22c149984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:47.088492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb10848-4aec-48d7-9d68-b3c22c149984 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:47.092249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb10848-4aec-48d7-9d68-b3c22c149984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:47.100493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb10848-4aec-48d7-9d68-b3c22c149984 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:47.130029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384c387-802c-4e10-90a6-4d6220b64959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:47.131555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384c387-802c-4e10-90a6-4d6220b64959 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:47.178877 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 791/1575] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:47.186223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384c387-802c-4e10-90a6-4d6220b64959 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:47.186904 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 785/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:46 2022] POST /identity/v3/projects => generated 383 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:47.217091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384c387-802c-4e10-90a6-4d6220b64959 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:47.396844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000491a-fa1b-4aa8-ae96-4ba0d6b316e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:47.397495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000491a-fa1b-4aa8-ae96-4ba0d6b316e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:47.397779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000491a-fa1b-4aa8-ae96-4ba0d6b316e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:47.398070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000491a-fa1b-4aa8-ae96-4ba0d6b316e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:47.415028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000491a-fa1b-4aa8-ae96-4ba0d6b316e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:47.418526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000491a-fa1b-4aa8-ae96-4ba0d6b316e9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:47.470077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 792/1577] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:47 2022] POST /identity/v3/users => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:47.475108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb10848-4aec-48d7-9d68-b3c22c149984 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:47.498647 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb10848-4aec-48d7-9d68-b3c22c149984 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:47.510976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312c55-57f1-4708-8487-c6d2c60c306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:47.512158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312c55-57f1-4708-8487-c6d2c60c306d admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:47.512750 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312c55-57f1-4708-8487-c6d2c60c306d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:47.513950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312c55-57f1-4708-8487-c6d2c60c306d admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:47.515483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312c55-57f1-4708-8487-c6d2c60c306d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:47.518729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67312c55-57f1-4708-8487-c6d2c60c306d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:47.539673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 786/1578] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:47.543901 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000491a-fa1b-4aa8-ae96-4ba0d6b316e9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:47.557555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000491a-fa1b-4aa8-ae96-4ba0d6b316e9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:47.562521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea50b0f-4e6b-4c9a-ba86-11360e5a690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:47.564275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea50b0f-4e6b-4c9a-ba86-11360e5a690e admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:47.564275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea50b0f-4e6b-4c9a-ba86-11360e5a690e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:47.564275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea50b0f-4e6b-4c9a-ba86-11360e5a690e admin admin] PATH_INFO: `/v3/projects/1f0956a89a85450abe11952aca6beaae/users/c2d97eb019c44bd58e2b0a8e4a2e7ee5/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:47.586115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea50b0f-4e6b-4c9a-ba86-11360e5a690e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0956a89a85450abe11952aca6beaae, user_id=c2d97eb019c44bd58e2b0a8e4a2e7ee5, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:47.587539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea50b0f-4e6b-4c9a-ba86-11360e5a690e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:47.628802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 793/1579] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:47 2022] PUT /identity/v3/projects/1f0956a89a85450abe11952aca6beaae/users/c2d97eb019c44bd58e2b0a8e4a2e7ee5/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:47.634493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312c55-57f1-4708-8487-c6d2c60c306d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:47.649787 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312c55-57f1-4708-8487-c6d2c60c306d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:47.712745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21245f-b4c9-4e8a-ad06-2e2bc5b1e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:47.713516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21245f-b4c9-4e8a-ad06-2e2bc5b1e25e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:47.713869 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21245f-b4c9-4e8a-ad06-2e2bc5b1e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:47.714161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21245f-b4c9-4e8a-ad06-2e2bc5b1e25e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:47.714931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21245f-b4c9-4e8a-ad06-2e2bc5b1e25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:47.716644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21245f-b4c9-4e8a-ad06-2e2bc5b1e25e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:47.732542 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 787/1580] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:47.733827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea50b0f-4e6b-4c9a-ba86-11360e5a690e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:47.757994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea50b0f-4e6b-4c9a-ba86-11360e5a690e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:47.763411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892e31-9ee4-40ab-906b-ff2e1712e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:47.764563 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892e31-9ee4-40ab-906b-ff2e1712e1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:47.764990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892e31-9ee4-40ab-906b-ff2e1712e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:47.765441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c892e31-9ee4-40ab-906b-ff2e1712e1ef admin admin] PATH_INFO: `/v3/projects/1f0956a89a85450abe11952aca6beaae/users/c2d97eb019c44bd58e2b0a8e4a2e7ee5/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:47.767983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c892e31-9ee4-40ab-906b-ff2e1712e1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0956a89a85450abe11952aca6beaae, user_id=c2d97eb019c44bd58e2b0a8e4a2e7ee5, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:47.771222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c892e31-9ee4-40ab-906b-ff2e1712e1ef admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:47.801190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 794/1581] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:47 2022] PUT /identity/v3/projects/1f0956a89a85450abe11952aca6beaae/users/c2d97eb019c44bd58e2b0a8e4a2e7ee5/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:47.804834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768232b-fdc7-48d1-bb22-a5eefe41a88d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:47.805247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768232b-fdc7-48d1-bb22-a5eefe41a88d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:47.805633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768232b-fdc7-48d1-bb22-a5eefe41a88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:47.814583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:47.843869 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6768232b-fdc7-48d1-bb22-a5eefe41a88d None None] MFA Rules not processed for user `c2d97eb019c44bd58e2b0a8e4a2e7ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:47.845122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6768232b-fdc7-48d1-bb22-a5eefe41a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:47.922738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 788/1582] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:47.933779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892e31-9ee4-40ab-906b-ff2e1712e1ef admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:47.992569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c892e31-9ee4-40ab-906b-ff2e1712e1ef admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:47.996133 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a7b01-d943-4470-930a-d0497401fec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:47.996771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a7b01-d943-4470-930a-d0497401fec7 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:47.997046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a7b01-d943-4470-930a-d0497401fec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:47.997312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a7b01-d943-4470-930a-d0497401fec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:48.018053 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:48.061546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a7b01-d943-4470-930a-d0497401fec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:48.063041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a7b01-d943-4470-930a-d0497401fec7 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:48.073730 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 795/1583] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:51.540969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768232b-fdc7-48d1-bb22-a5eefe41a88d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:51.542366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6768232b-fdc7-48d1-bb22-a5eefe41a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:51.606417 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768232b-fdc7-48d1-bb22-a5eefe41a88d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:51.611018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:51.611641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:51.611921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:51.612450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] PATH_INFO: `/v3/users/5031e770722a4f3286f575e3f5409551` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:51.613592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5031e770722a4f3286f575e3f5409551)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:51.616039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:51.662168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5031e770722a4f3286f575e3f5409551'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:51.662734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5031e770722a4f3286f575e3f5409551'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:51.670873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5031e770722a4f3286f575e3f5409551'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:51.671525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5031e770722a4f3286f575e3f5409551'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:51.684512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5031e770722a4f3286f575e3f5409551'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:51.698245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 789/1584] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:51 2022] DELETE /identity/v3/users/5031e770722a4f3286f575e3f5409551 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:51.702753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d46f-81e7-4f89-ac68-3012d685370e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:51.703221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d46f-81e7-4f89-ac68-3012d685370e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:51.703578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d46f-81e7-4f89-ac68-3012d685370e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:51.731335 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b741d46f-81e7-4f89-ac68-3012d685370e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:51.732816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b741d46f-81e7-4f89-ac68-3012d685370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:51.797404 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 796/1585] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:51.807404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:51.808841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:51.820332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:51.870824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c1c26-f86d-4eff-ac3b-9614e93f39cf admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:51.874665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d852a1-ed7f-4887-be91-2141f5b60b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:51.875280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d852a1-ed7f-4887-be91-2141f5b60b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:51.875559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d852a1-ed7f-4887-be91-2141f5b60b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:51.875827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d852a1-ed7f-4887-be91-2141f5b60b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:51.891078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d852a1-ed7f-4887-be91-2141f5b60b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:51.892806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d852a1-ed7f-4887-be91-2141f5b60b2d service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:51.905163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 790/1586] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:52.261783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d46f-81e7-4f89-ac68-3012d685370e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:52.263441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b741d46f-81e7-4f89-ac68-3012d685370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:52.278270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d46f-81e7-4f89-ac68-3012d685370e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:52.284340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:52.285628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:52.285628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:52.285628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] PATH_INFO: `/v3/projects/34b181fcddcf4d78b35485cd09b162fe` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:52.287179 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b181fcddcf4d78b35485cd09b162fe)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:52.289204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:52.344964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b181fcddcf4d78b35485cd09b162fe', 'request_id': 'req-2338e691-48c8-4720-85a0-0a4ecf050d3d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:52.351185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b181fcddcf4d78b35485cd09b162fe', 'request_id': 'req-2338e691-48c8-4720-85a0-0a4ecf050d3d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:52.357475 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b181fcddcf4d78b35485cd09b162fe', 'request_id': 'req-2338e691-48c8-4720-85a0-0a4ecf050d3d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:52.369065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] The token cache is being invalidate because project 34b181fcddcf4d78b35485cd09b162fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:52.369355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:52.370025 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:52.371511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 797/1587] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:52 2022] DELETE /identity/v3/projects/34b181fcddcf4d78b35485cd09b162fe => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:52.375448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d852a1-ed7f-4887-be91-2141f5b60b2d service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:52.385534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d852a1-ed7f-4887-be91-2141f5b60b2d service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:52.445016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:52.445660 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:52.445945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:52.446217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] PATH_INFO: `/v3/users/d8351df9a44d462b9f292d96b7af6be2` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:52.447354 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8351df9a44d462b9f292d96b7af6be2)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:52.449321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:52.504742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8351df9a44d462b9f292d96b7af6be2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:52.505353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8351df9a44d462b9f292d96b7af6be2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:52.513661 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8351df9a44d462b9f292d96b7af6be2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:52.513854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8351df9a44d462b9f292d96b7af6be2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:52.529077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8351df9a44d462b9f292d96b7af6be2'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:52.563388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:52.565386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:52.578495 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 791/1588] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:52 2022] DELETE /identity/v3/users/d8351df9a44d462b9f292d96b7af6be2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:52.636030 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:52.650327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338e691-48c8-4720-85a0-0a4ecf050d3d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:52.710290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063da8a6-d74c-4c02-b0fb-640fd4024fb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:52.711024 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063da8a6-d74c-4c02-b0fb-640fd4024fb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:52.711304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063da8a6-d74c-4c02-b0fb-640fd4024fb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:52.711574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063da8a6-d74c-4c02-b0fb-640fd4024fb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:52.713768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-063da8a6-d74c-4c02-b0fb-640fd4024fb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:52.783072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063da8a6-d74c-4c02-b0fb-640fd4024fb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:52.784683 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063da8a6-d74c-4c02-b0fb-640fd4024fb9 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:52.796873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 798/1589] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:34:52.898036 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:52.899677 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:52.937827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:52.977633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8a003-f379-4343-ba48-8b4a49466124 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:52.982865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:52.983836 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:52.984205 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:52.984507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] PATH_INFO: `/v3/projects/786a578d494a48f8a164eb97ba4354aa` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:52.985700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=786a578d494a48f8a164eb97ba4354aa)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:52.987885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:53.047411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786a578d494a48f8a164eb97ba4354aa', 'request_id': 'req-6b3c8ff4-d080-42a4-9446-dabe7012db80'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.059650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786a578d494a48f8a164eb97ba4354aa', 'request_id': 'req-6b3c8ff4-d080-42a4-9446-dabe7012db80'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.069910 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786a578d494a48f8a164eb97ba4354aa', 'request_id': 'req-6b3c8ff4-d080-42a4-9446-dabe7012db80'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.083421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] The token cache is being invalidate because project 786a578d494a48f8a164eb97ba4354aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:53.083912 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.084691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.086644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 792/1590] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:52 2022] DELETE /identity/v3/projects/786a578d494a48f8a164eb97ba4354aa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:53.090632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063da8a6-d74c-4c02-b0fb-640fd4024fb9 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:53.106637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063da8a6-d74c-4c02-b0fb-640fd4024fb9 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:53.209888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:53.210738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:53.211387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:53.212032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] PATH_INFO: `/v3/users/5eecc813fba54921a542d4960671de5d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:53.213277 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eecc813fba54921a542d4960671de5d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:53.215608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:53.291644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eecc813fba54921a542d4960671de5d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.292619 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eecc813fba54921a542d4960671de5d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.299768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:53.307186 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eecc813fba54921a542d4960671de5d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.320362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eecc813fba54921a542d4960671de5d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.321359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7af13d53-6c6d-4283-82fe-0bf7fe16a921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eecc813fba54921a542d4960671de5d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.351210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 799/1591] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:53 2022] DELETE /identity/v3/users/5eecc813fba54921a542d4960671de5d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:53.802880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:53.804481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:53.817873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c8ff4-d080-42a4-9446-dabe7012db80 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:53.883563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:53.884156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:53.884517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:53.884794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] PATH_INFO: `/v3/projects/7f4d48b1084b4fcfa0a300f66a56d16b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:53.886031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4d48b1084b4fcfa0a300f66a56d16b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:53.888188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:53.935852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4d48b1084b4fcfa0a300f66a56d16b', 'request_id': 'req-e1944c8e-e725-402c-8c8c-d5fa37759c18'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.943779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4d48b1084b4fcfa0a300f66a56d16b', 'request_id': 'req-e1944c8e-e725-402c-8c8c-d5fa37759c18'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.948815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:53.950232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4d48b1084b4fcfa0a300f66a56d16b', 'request_id': 'req-e1944c8e-e725-402c-8c8c-d5fa37759c18'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.965169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] The token cache is being invalidate because project 7f4d48b1084b4fcfa0a300f66a56d16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:53.965553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.966311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1944c8e-e725-402c-8c8c-d5fa37759c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:53.967867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 793/1592] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:53 2022] DELETE /identity/v3/projects/7f4d48b1084b4fcfa0a300f66a56d16b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:53.974178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07698597-e9f7-485b-b4b4-04ac65123602 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:53.974696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07698597-e9f7-485b-b4b4-04ac65123602 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:53.974773 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07698597-e9f7-485b-b4b4-04ac65123602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:53.995470 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-07698597-e9f7-485b-b4b4-04ac65123602 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:53.996733 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-07698597-e9f7-485b-b4b4-04ac65123602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:54.066646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 800/1593] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:54.075279 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705e559-5326-45af-af68-406effa9c7c4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:54.075569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705e559-5326-45af-af68-406effa9c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:54.075844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705e559-5326-45af-af68-406effa9c7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:54.110989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f705e559-5326-45af-af68-406effa9c7c4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:54.112502 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f705e559-5326-45af-af68-406effa9c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:54.122366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 794/1594] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:54.126752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07698597-e9f7-485b-b4b4-04ac65123602 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:54.137385 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07698597-e9f7-485b-b4b4-04ac65123602 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:54.142113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b241e-5603-41d4-9385-59187314c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:54.142795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b241e-5603-41d4-9385-59187314c24e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:54.143147 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b241e-5603-41d4-9385-59187314c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:54.143490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b241e-5603-41d4-9385-59187314c24e admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:54.144212 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b241e-5603-41d4-9385-59187314c24e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:54.144623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b241e-5603-41d4-9385-59187314c24e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:54.146337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b241e-5603-41d4-9385-59187314c24e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:54.157977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 801/1595] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:54.162394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705e559-5326-45af-af68-406effa9c7c4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:54.171462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705e559-5326-45af-af68-406effa9c7c4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:54.176063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eccf5e-908f-4840-916d-6624e9c03a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:54.177276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eccf5e-908f-4840-916d-6624e9c03a9b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:54.177480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eccf5e-908f-4840-916d-6624e9c03a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:54.177752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eccf5e-908f-4840-916d-6624e9c03a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:54.178377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eccf5e-908f-4840-916d-6624e9c03a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:54.180257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eccf5e-908f-4840-916d-6624e9c03a9b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:54.220992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 795/1596] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:54 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:54.227652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b241e-5603-41d4-9385-59187314c24e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:54.246297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b241e-5603-41d4-9385-59187314c24e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:54.372293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83e857-c620-421d-bc0d-930cfa31f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:54.373123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83e857-c620-421d-bc0d-930cfa31f4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:54.376669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83e857-c620-421d-bc0d-930cfa31f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:54.377086 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83e857-c620-421d-bc0d-930cfa31f4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:54.377935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83e857-c620-421d-bc0d-930cfa31f4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:54.384954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83e857-c620-421d-bc0d-930cfa31f4f2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:54.438602 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 802/1597] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:54 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:54.439970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eccf5e-908f-4840-916d-6624e9c03a9b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:54.455650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eccf5e-908f-4840-916d-6624e9c03a9b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:54.470669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a8cba-d6cb-481e-8ce4-3efa6e1b7a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:54.471337 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a8cba-d6cb-481e-8ce4-3efa6e1b7a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:54.471622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a8cba-d6cb-481e-8ce4-3efa6e1b7a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:54.472020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a8cba-d6cb-481e-8ce4-3efa6e1b7a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:54.472717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a8cba-d6cb-481e-8ce4-3efa6e1b7a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:54.497718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a8cba-d6cb-481e-8ce4-3efa6e1b7a3c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:54.514791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 796/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:54.519845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83e857-c620-421d-bc0d-930cfa31f4f2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:54.542585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83e857-c620-421d-bc0d-930cfa31f4f2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:54.557873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec432a-a837-4b03-b701-f65f2a9762e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:54.559046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec432a-a837-4b03-b701-f65f2a9762e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:54.560886 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec432a-a837-4b03-b701-f65f2a9762e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:54.561318 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec432a-a837-4b03-b701-f65f2a9762e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:54.562125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec432a-a837-4b03-b701-f65f2a9762e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:54.564164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec432a-a837-4b03-b701-f65f2a9762e1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:54.580532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 803/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:54.585641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a8cba-d6cb-481e-8ce4-3efa6e1b7a3c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:54.598105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a8cba-d6cb-481e-8ce4-3efa6e1b7a3c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:54.605812 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0b791-2017-48a8-bbb7-8215804f4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:54.606874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0b791-2017-48a8-bbb7-8215804f4dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:54.607617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0b791-2017-48a8-bbb7-8215804f4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:54.607979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0b791-2017-48a8-bbb7-8215804f4dc9 admin admin] PATH_INFO: `/v3/projects/0173441982fc4a0899f4cef11d1a896b/users/fdc388f4208a4e888bf24df6ebfc3698/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:54.650801 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0b791-2017-48a8-bbb7-8215804f4dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0173441982fc4a0899f4cef11d1a896b, user_id=fdc388f4208a4e888bf24df6ebfc3698, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:54.653986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0b791-2017-48a8-bbb7-8215804f4dc9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:54.669760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 797/1600] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:34:54 2022] PUT /identity/v3/projects/0173441982fc4a0899f4cef11d1a896b/users/fdc388f4208a4e888bf24df6ebfc3698/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:54.683861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1add24-c6f0-4c1e-af4d-07a1cfecc178 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:54.684644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1add24-c6f0-4c1e-af4d-07a1cfecc178 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:54.685378 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1add24-c6f0-4c1e-af4d-07a1cfecc178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:54.738348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1e1add24-c6f0-4c1e-af4d-07a1cfecc178 None None] MFA Rules not processed for user `fdc388f4208a4e888bf24df6ebfc3698`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:54.740511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1e1add24-c6f0-4c1e-af4d-07a1cfecc178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:54.774647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:54.823879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 804/1601] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:54.835476 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0b791-2017-48a8-bbb7-8215804f4dc9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:54.837486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3ea0b791-2017-48a8-bbb7-8215804f4dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:54.905674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0b791-2017-48a8-bbb7-8215804f4dc9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:54.911058 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603515b7-e2a4-47f4-9279-9835ab91c8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:54.911978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603515b7-e2a4-47f4-9279-9835ab91c8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:54.912318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603515b7-e2a4-47f4-9279-9835ab91c8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:54.912682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603515b7-e2a4-47f4-9279-9835ab91c8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:54.923175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603515b7-e2a4-47f4-9279-9835ab91c8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:54.924989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603515b7-e2a4-47f4-9279-9835ab91c8a4 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:54.943900 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 798/1602] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:57.575984 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1add24-c6f0-4c1e-af4d-07a1cfecc178 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:57.650286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1add24-c6f0-4c1e-af4d-07a1cfecc178 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:57.654932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:57.655595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:57.655872 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:57.656145 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] PATH_INFO: `/v3/users/fdc388f4208a4e888bf24df6ebfc3698` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:57.657292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc388f4208a4e888bf24df6ebfc3698)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:57.659237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:57.705091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc388f4208a4e888bf24df6ebfc3698'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:57.705749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc388f4208a4e888bf24df6ebfc3698'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:57.713077 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc388f4208a4e888bf24df6ebfc3698'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:57.720147 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc388f4208a4e888bf24df6ebfc3698'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:57.720803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc388f4208a4e888bf24df6ebfc3698'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:57.739623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 805/1603] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:57 2022] DELETE /identity/v3/users/fdc388f4208a4e888bf24df6ebfc3698 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:57.744660 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c912c66-0318-4e06-a0af-9fb344c78ba7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:57.745186 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c912c66-0318-4e06-a0af-9fb344c78ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:57.745289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c912c66-0318-4e06-a0af-9fb344c78ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:57.763926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0c912c66-0318-4e06-a0af-9fb344c78ba7 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:57.765154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0c912c66-0318-4e06-a0af-9fb344c78ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:57.826935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 799/1604] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:57.837157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:57.838557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:57.885638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:57.898505 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14296d-6940-40f8-b19f-b4a18cc625ed admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:57.902119 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561d476-faf2-4368-beda-29d22a83a5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:57.902723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561d476-faf2-4368-beda-29d22a83a5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:57.903005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561d476-faf2-4368-beda-29d22a83a5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:57.903283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561d476-faf2-4368-beda-29d22a83a5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:57.913415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561d476-faf2-4368-beda-29d22a83a5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:57.914862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561d476-faf2-4368-beda-29d22a83a5c5 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:57.924242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 806/1605] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:57.953774 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c912c66-0318-4e06-a0af-9fb344c78ba7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:57.955179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0c912c66-0318-4e06-a0af-9fb344c78ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:57.968780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c912c66-0318-4e06-a0af-9fb344c78ba7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:57.974648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:57.975431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:57.975746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:57.976022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] PATH_INFO: `/v3/users/00a64f01e77a4898a25d32e893754a0d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:57.977376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a64f01e77a4898a25d32e893754a0d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:57.979624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:58.010877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:58.033714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a64f01e77a4898a25d32e893754a0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.034481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a64f01e77a4898a25d32e893754a0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.043909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a64f01e77a4898a25d32e893754a0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.044797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a64f01e77a4898a25d32e893754a0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.061955 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a64f01e77a4898a25d32e893754a0d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.078995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 800/1606] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:57 2022] DELETE /identity/v3/users/00a64f01e77a4898a25d32e893754a0d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:58.084174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef636446-45f4-4e18-9cb1-922dcc38478b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:58.084481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef636446-45f4-4e18-9cb1-922dcc38478b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:58.084760 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef636446-45f4-4e18-9cb1-922dcc38478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:58.105941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ef636446-45f4-4e18-9cb1-922dcc38478b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:58.107179 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef636446-45f4-4e18-9cb1-922dcc38478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:58.184529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 807/1607] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:58.196378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:58.198077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:58.229741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef636446-45f4-4e18-9cb1-922dcc38478b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:58.231884 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef636446-45f4-4e18-9cb1-922dcc38478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:58.265082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef636446-45f4-4e18-9cb1-922dcc38478b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:58.270733 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:58.271588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:58.271888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:58.272155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] PATH_INFO: `/v3/projects/0173441982fc4a0899f4cef11d1a896b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:58.273362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0173441982fc4a0899f4cef11d1a896b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:58.275482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:58.280870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ca3ef-99d2-4399-a6e9-a286fda9d4aa admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:58.284409 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f0e12-0fcc-4e4f-8664-7c6bcd55f7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:58.285056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0e12-0fcc-4e4f-8664-7c6bcd55f7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:58.285334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0e12-0fcc-4e4f-8664-7c6bcd55f7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:58.285664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0e12-0fcc-4e4f-8664-7c6bcd55f7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:58.295316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f0e12-0fcc-4e4f-8664-7c6bcd55f7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:58.296770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f0e12-0fcc-4e4f-8664-7c6bcd55f7f3 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:58.307428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 801/1608] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:34:58.336582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0173441982fc4a0899f4cef11d1a896b', 'request_id': 'req-d8df2eb8-ed10-4f80-a123-569392c51501'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.359580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0173441982fc4a0899f4cef11d1a896b', 'request_id': 'req-d8df2eb8-ed10-4f80-a123-569392c51501'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.370255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0173441982fc4a0899f4cef11d1a896b', 'request_id': 'req-d8df2eb8-ed10-4f80-a123-569392c51501'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.391895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] The token cache is being invalidate because project 0173441982fc4a0899f4cef11d1a896b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:58.392732 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.394266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.397763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 808/1609] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:58 2022] DELETE /identity/v3/projects/0173441982fc4a0899f4cef11d1a896b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:58.679228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f0e12-0fcc-4e4f-8664-7c6bcd55f7f3 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:58.680691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3a5f0e12-0fcc-4e4f-8664-7c6bcd55f7f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:58.699967 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f0e12-0fcc-4e4f-8664-7c6bcd55f7f3 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:58.763773 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:58.764416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:58.764807 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:58.765083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] PATH_INFO: `/v3/projects/12c82af25a13411385685b6cf523ee06` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:58.766223 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c82af25a13411385685b6cf523ee06)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:58.768513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:58.822142 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:58.824534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c82af25a13411385685b6cf523ee06', 'request_id': 'req-7a9c65b2-0e3e-40a1-bddc-f53286d02197'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.833400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c82af25a13411385685b6cf523ee06', 'request_id': 'req-7a9c65b2-0e3e-40a1-bddc-f53286d02197'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.839442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c82af25a13411385685b6cf523ee06', 'request_id': 'req-7a9c65b2-0e3e-40a1-bddc-f53286d02197'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.851161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] The token cache is being invalidate because project 12c82af25a13411385685b6cf523ee06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:58.851446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.852235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.854217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 802/1610] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:58 2022] DELETE /identity/v3/projects/12c82af25a13411385685b6cf523ee06 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:58.857951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:58.859487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:58.873371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2eb8-ed10-4f80-a123-569392c51501 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:58.932925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:58.933559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:58.933841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:58.934117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] PATH_INFO: `/v3/users/c2d97eb019c44bd58e2b0a8e4a2e7ee5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:58.935247 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d97eb019c44bd58e2b0a8e4a2e7ee5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:58.937191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:58.949707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:34:58.983191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d97eb019c44bd58e2b0a8e4a2e7ee5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.983863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d97eb019c44bd58e2b0a8e4a2e7ee5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.991394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d97eb019c44bd58e2b0a8e4a2e7ee5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.998771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d97eb019c44bd58e2b0a8e4a2e7ee5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:58.999411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8944ff4c-0c10-4730-98c5-8888a7a2237b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d97eb019c44bd58e2b0a8e4a2e7ee5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:59.017306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 809/1611] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:34:58 2022] DELETE /identity/v3/users/c2d97eb019c44bd58e2b0a8e4a2e7ee5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:59.289980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:59.291428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:59.305837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c65b2-0e3e-40a1-bddc-f53286d02197 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:59.372559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:59.372559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:59.372926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:59.372926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] PATH_INFO: `/v3/projects/1f0956a89a85450abe11952aca6beaae` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:59.374515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0956a89a85450abe11952aca6beaae)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:59.376559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:59.446426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0956a89a85450abe11952aca6beaae', 'request_id': 'req-b96a23b3-3813-4de7-9bdf-05dd450b01b3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:59.455789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0956a89a85450abe11952aca6beaae', 'request_id': 'req-b96a23b3-3813-4de7-9bdf-05dd450b01b3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:59.464063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0956a89a85450abe11952aca6beaae', 'request_id': 'req-b96a23b3-3813-4de7-9bdf-05dd450b01b3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:59.478732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] The token cache is being invalidate because project 1f0956a89a85450abe11952aca6beaae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:34:59.479189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:59.480393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b96a23b3-3813-4de7-9bdf-05dd450b01b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:34:59.488154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 803/1612] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:34:59 2022] DELETE /identity/v3/projects/1f0956a89a85450abe11952aca6beaae => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:34:59.489687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef4736-4c77-4070-8ff5-b4febd4c55c2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:59.490318 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef4736-4c77-4070-8ff5-b4febd4c55c2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:59.490596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef4736-4c77-4070-8ff5-b4febd4c55c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:59.526445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aaef4736-4c77-4070-8ff5-b4febd4c55c2 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:59.527743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aaef4736-4c77-4070-8ff5-b4febd4c55c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:59.690464 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac9880-9f85-4ab7-bfd5-cb29c860cdab None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:59.690942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac9880-9f85-4ab7-bfd5-cb29c860cdab None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:59.691416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac9880-9f85-4ab7-bfd5-cb29c860cdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:59.698084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 810/1613] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:34:59.727176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9fac9880-9f85-4ab7-bfd5-cb29c860cdab None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:34:59.728560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9fac9880-9f85-4ab7-bfd5-cb29c860cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:34:59.740368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 804/1614] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:34:59.744559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef4736-4c77-4070-8ff5-b4febd4c55c2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:59.756493 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef4736-4c77-4070-8ff5-b4febd4c55c2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:59.762712 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38366313-fa81-4f3d-be92-5a08735a5d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:59.763659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38366313-fa81-4f3d-be92-5a08735a5d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:59.764117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38366313-fa81-4f3d-be92-5a08735a5d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:59.764483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38366313-fa81-4f3d-be92-5a08735a5d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:59.765250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38366313-fa81-4f3d-be92-5a08735a5d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:34:59.766200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38366313-fa81-4f3d-be92-5a08735a5d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:59.768033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38366313-fa81-4f3d-be92-5a08735a5d2a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:59.781574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 811/1615] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:34:59.786640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac9880-9f85-4ab7-bfd5-cb29c860cdab None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:59.801429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac9880-9f85-4ab7-bfd5-cb29c860cdab None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:59.806415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1001dc6-6531-4920-be32-967a28f7dfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:59.807121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1001dc6-6531-4920-be32-967a28f7dfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:59.807469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1001dc6-6531-4920-be32-967a28f7dfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:59.807808 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1001dc6-6531-4920-be32-967a28f7dfa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:59.808448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1001dc6-6531-4920-be32-967a28f7dfa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:59.810380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1001dc6-6531-4920-be32-967a28f7dfa6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:59.841753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 805/1616] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:34:59 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:34:59.846083 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38366313-fa81-4f3d-be92-5a08735a5d2a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:59.857130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38366313-fa81-4f3d-be92-5a08735a5d2a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:59.930173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d86b37-0ceb-4667-b6d5-00c248a9a74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:59.931046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86b37-0ceb-4667-b6d5-00c248a9a74b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:59.931332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86b37-0ceb-4667-b6d5-00c248a9a74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:59.931607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86b37-0ceb-4667-b6d5-00c248a9a74b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:59.932246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d86b37-0ceb-4667-b6d5-00c248a9a74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:59.935081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d86b37-0ceb-4667-b6d5-00c248a9a74b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:59.959989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 812/1617] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:34:59 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:34:59.963832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1001dc6-6531-4920-be32-967a28f7dfa6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:34:59.973982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1001dc6-6531-4920-be32-967a28f7dfa6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:34:59.978560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de013235-9835-4eca-95aa-f9c6b05241b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:34:59.979165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de013235-9835-4eca-95aa-f9c6b05241b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:34:59.979461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de013235-9835-4eca-95aa-f9c6b05241b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:34:59.979728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de013235-9835-4eca-95aa-f9c6b05241b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:34:59.980368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de013235-9835-4eca-95aa-f9c6b05241b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:34:59.982011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de013235-9835-4eca-95aa-f9c6b05241b3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:34:59.993422 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 806/1618] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:34:59.997532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d86b37-0ceb-4667-b6d5-00c248a9a74b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.008409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d86b37-0ceb-4667-b6d5-00c248a9a74b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.013175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c12b-9536-41ba-96fc-b078cf49101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.014830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c12b-9536-41ba-96fc-b078cf49101f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.015250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c12b-9536-41ba-96fc-b078cf49101f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.015527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c12b-9536-41ba-96fc-b078cf49101f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.016253 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047c12b-9536-41ba-96fc-b078cf49101f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.017830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047c12b-9536-41ba-96fc-b078cf49101f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.019260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:00.030829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 813/1619] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:00.035376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de013235-9835-4eca-95aa-f9c6b05241b3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.046194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de013235-9835-4eca-95aa-f9c6b05241b3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.058369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0028af-869d-4cd9-bf47-a697065fbc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.058935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0028af-869d-4cd9-bf47-a697065fbc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.059217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0028af-869d-4cd9-bf47-a697065fbc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.059488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0028af-869d-4cd9-bf47-a697065fbc9d admin admin] PATH_INFO: `/v3/projects/57b8dfc996ee4d1299e50dc172cbfb38/users/d94cf7f8672a45fb8e264a932e2a11d5/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.077927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0028af-869d-4cd9-bf47-a697065fbc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b8dfc996ee4d1299e50dc172cbfb38, user_id=d94cf7f8672a45fb8e264a932e2a11d5, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.080651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0028af-869d-4cd9-bf47-a697065fbc9d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.096555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 807/1620] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:00 2022] PUT /identity/v3/projects/57b8dfc996ee4d1299e50dc172cbfb38/users/d94cf7f8672a45fb8e264a932e2a11d5/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:00.118216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1e89e-3090-4595-9764-830654d9d270 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.118537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1e89e-3090-4595-9764-830654d9d270 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.118813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1e89e-3090-4595-9764-830654d9d270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.149492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5cc1e89e-3090-4595-9764-830654d9d270 None None] MFA Rules not processed for user `d94cf7f8672a45fb8e264a932e2a11d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:00.150717 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5cc1e89e-3090-4595-9764-830654d9d270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:00.222787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 814/1621] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:00.227413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0028af-869d-4cd9-bf47-a697065fbc9d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.232331 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:00.297597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0028af-869d-4cd9-bf47-a697065fbc9d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.303106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535c37c-2efa-45b5-ae87-8de75ab6b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.303736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535c37c-2efa-45b5-ae87-8de75ab6b75f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.304043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535c37c-2efa-45b5-ae87-8de75ab6b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.304334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535c37c-2efa-45b5-ae87-8de75ab6b75f admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.305065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535c37c-2efa-45b5-ae87-8de75ab6b75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.306980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535c37c-2efa-45b5-ae87-8de75ab6b75f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.337350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 808/1622] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:00 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:00.341543 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1e89e-3090-4595-9764-830654d9d270 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.353439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1e89e-3090-4595-9764-830654d9d270 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.429230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e4015-3139-445f-b921-43e4d1b5e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.429860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4015-3139-445f-b921-43e4d1b5e2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.430195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4015-3139-445f-b921-43e4d1b5e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.430479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4015-3139-445f-b921-43e4d1b5e2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.431119 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e4015-3139-445f-b921-43e4d1b5e2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.433657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e4015-3139-445f-b921-43e4d1b5e2c1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.462153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 815/1623] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:00 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:35:00.463990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535c37c-2efa-45b5-ae87-8de75ab6b75f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.477579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535c37c-2efa-45b5-ae87-8de75ab6b75f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.482929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd47f9-cc75-4066-9a95-066c5207f3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.483595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd47f9-cc75-4066-9a95-066c5207f3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.483880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd47f9-cc75-4066-9a95-066c5207f3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.484503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd47f9-cc75-4066-9a95-066c5207f3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.484832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd47f9-cc75-4066-9a95-066c5207f3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.486444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd47f9-cc75-4066-9a95-066c5207f3f6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.499514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 809/1624] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:00.503323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e4015-3139-445f-b921-43e4d1b5e2c1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.517941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e4015-3139-445f-b921-43e4d1b5e2c1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.524311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c107f9-e229-4e88-8c86-3035e9c60456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.524930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c107f9-e229-4e88-8c86-3035e9c60456 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.525639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c107f9-e229-4e88-8c86-3035e9c60456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.525639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c107f9-e229-4e88-8c86-3035e9c60456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.526196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c107f9-e229-4e88-8c86-3035e9c60456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.527827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c107f9-e229-4e88-8c86-3035e9c60456 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.539133 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 816/1625] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:35:00.543066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd47f9-cc75-4066-9a95-066c5207f3f6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.553715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd47f9-cc75-4066-9a95-066c5207f3f6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.558425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736413-e6cc-4dd7-9a34-88aeb3222cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.559074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736413-e6cc-4dd7-9a34-88aeb3222cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.559359 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736413-e6cc-4dd7-9a34-88aeb3222cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.559632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736413-e6cc-4dd7-9a34-88aeb3222cf9 admin admin] PATH_INFO: `/v3/projects/592a6f6293e74f11ab7eebd111790dee/users/93ad09a651634c8aacc54847b2895b63/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.574267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736413-e6cc-4dd7-9a34-88aeb3222cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592a6f6293e74f11ab7eebd111790dee, user_id=93ad09a651634c8aacc54847b2895b63, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.576976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736413-e6cc-4dd7-9a34-88aeb3222cf9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.589551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 810/1626] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:00 2022] PUT /identity/v3/projects/592a6f6293e74f11ab7eebd111790dee/users/93ad09a651634c8aacc54847b2895b63/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:00.599883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd92d3-c0ef-4a9e-b5a5-4f73580acf80 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.600288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd92d3-c0ef-4a9e-b5a5-4f73580acf80 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.600697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd92d3-c0ef-4a9e-b5a5-4f73580acf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.628992 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7acd92d3-c0ef-4a9e-b5a5-4f73580acf80 None None] MFA Rules not processed for user `93ad09a651634c8aacc54847b2895b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:00.630571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7acd92d3-c0ef-4a9e-b5a5-4f73580acf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:00.684906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:00.695747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 817/1627] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:00.700294 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736413-e6cc-4dd7-9a34-88aeb3222cf9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.762479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736413-e6cc-4dd7-9a34-88aeb3222cf9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.766923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc2d9-1a5d-4a8f-861e-ba69d6f71e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.767519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc2d9-1a5d-4a8f-861e-ba69d6f71e91 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.767798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc2d9-1a5d-4a8f-861e-ba69d6f71e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.768069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc2d9-1a5d-4a8f-861e-ba69d6f71e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.768720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc2d9-1a5d-4a8f-861e-ba69d6f71e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.770968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc2d9-1a5d-4a8f-861e-ba69d6f71e91 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.799010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 811/1628] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:00 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:00.803585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd92d3-c0ef-4a9e-b5a5-4f73580acf80 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.814321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd92d3-c0ef-4a9e-b5a5-4f73580acf80 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.872522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee21e5-8a65-45ee-a5de-bdddf9f53f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.873142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee21e5-8a65-45ee-a5de-bdddf9f53f22 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.873425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee21e5-8a65-45ee-a5de-bdddf9f53f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.873734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee21e5-8a65-45ee-a5de-bdddf9f53f22 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.874339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee21e5-8a65-45ee-a5de-bdddf9f53f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.876249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee21e5-8a65-45ee-a5de-bdddf9f53f22 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.900535 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 818/1629] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:00 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:00.904588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc2d9-1a5d-4a8f-861e-ba69d6f71e91 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.918561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc2d9-1a5d-4a8f-861e-ba69d6f71e91 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.923363 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fae04-99b0-4f47-92ae-6e2d895301fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.923973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fae04-99b0-4f47-92ae-6e2d895301fc admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.924255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fae04-99b0-4f47-92ae-6e2d895301fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.924563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fae04-99b0-4f47-92ae-6e2d895301fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.925239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fae04-99b0-4f47-92ae-6e2d895301fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.926960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fae04-99b0-4f47-92ae-6e2d895301fc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.938039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 812/1630] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:35:00.942279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee21e5-8a65-45ee-a5de-bdddf9f53f22 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:00.952180 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee21e5-8a65-45ee-a5de-bdddf9f53f22 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:00.956989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccebcb0-1f4b-4e9d-8d8b-9c2243d1a245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:00.958151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccebcb0-1f4b-4e9d-8d8b-9c2243d1a245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:00.958433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccebcb0-1f4b-4e9d-8d8b-9c2243d1a245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:00.958707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccebcb0-1f4b-4e9d-8d8b-9c2243d1a245 admin admin] PATH_INFO: `/v3/projects/94dc2bea5cb142f39c43fe5d01c9274a/users/fbc0c812cac94f54a7714d034f91b40f/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:00.974831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccebcb0-1f4b-4e9d-8d8b-9c2243d1a245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94dc2bea5cb142f39c43fe5d01c9274a, user_id=fbc0c812cac94f54a7714d034f91b40f, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:00.977591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccebcb0-1f4b-4e9d-8d8b-9c2243d1a245 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:00.991888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 819/1631] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:00 2022] PUT /identity/v3/projects/94dc2bea5cb142f39c43fe5d01c9274a/users/fbc0c812cac94f54a7714d034f91b40f/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:00.995724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fae04-99b0-4f47-92ae-6e2d895301fc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:01.006263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fae04-99b0-4f47-92ae-6e2d895301fc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:01.030903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:01.074400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42fc29-7311-4f03-a0fc-968d697cf98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:01.075012 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42fc29-7311-4f03-a0fc-968d697cf98e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:01.075286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42fc29-7311-4f03-a0fc-968d697cf98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:01.075554 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42fc29-7311-4f03-a0fc-968d697cf98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:01.076191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42fc29-7311-4f03-a0fc-968d697cf98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:01.077831 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42fc29-7311-4f03-a0fc-968d697cf98e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:01.088575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 813/1632] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:35:01.092594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccebcb0-1f4b-4e9d-8d8b-9c2243d1a245 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:01.104825 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccebcb0-1f4b-4e9d-8d8b-9c2243d1a245 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:01.121385 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000ea2-2eb5-41f8-a3bf-12e99f856b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:01.125165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000ea2-2eb5-41f8-a3bf-12e99f856b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:01.125525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000ea2-2eb5-41f8-a3bf-12e99f856b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:01.125892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000ea2-2eb5-41f8-a3bf-12e99f856b24 admin admin] PATH_INFO: `/v3/projects/94dc2bea5cb142f39c43fe5d01c9274a/users/fbc0c812cac94f54a7714d034f91b40f/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:01.128048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8000ea2-2eb5-41f8-a3bf-12e99f856b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94dc2bea5cb142f39c43fe5d01c9274a, user_id=fbc0c812cac94f54a7714d034f91b40f, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:01.132451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8000ea2-2eb5-41f8-a3bf-12e99f856b24 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:01.145318 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 820/1633] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:01 2022] PUT /identity/v3/projects/94dc2bea5cb142f39c43fe5d01c9274a/users/fbc0c812cac94f54a7714d034f91b40f/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:01.155587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc127f-93d8-4778-a30b-fe5c3089e5f9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:01.155873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc127f-93d8-4778-a30b-fe5c3089e5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:01.156143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc127f-93d8-4778-a30b-fe5c3089e5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:01.185397 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e7cc127f-93d8-4778-a30b-fe5c3089e5f9 None None] MFA Rules not processed for user `fbc0c812cac94f54a7714d034f91b40f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:01.186597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e7cc127f-93d8-4778-a30b-fe5c3089e5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:01.257747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 814/1634] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:01.269433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000ea2-2eb5-41f8-a3bf-12e99f856b24 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:01.271224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d8000ea2-2eb5-41f8-a3bf-12e99f856b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:01.333009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000ea2-2eb5-41f8-a3bf-12e99f856b24 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:01.339845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7410eb-7e2b-4804-b68f-22d64b320bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:01.340566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7410eb-7e2b-4804-b68f-22d64b320bcb service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:01.340851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7410eb-7e2b-4804-b68f-22d64b320bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:01.341124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7410eb-7e2b-4804-b68f-22d64b320bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:01.403334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7410eb-7e2b-4804-b68f-22d64b320bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:01.404802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7410eb-7e2b-4804-b68f-22d64b320bcb service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:01.410071 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:01.415953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 821/1635] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:03.061325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc127f-93d8-4778-a30b-fe5c3089e5f9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:03.063081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e7cc127f-93d8-4778-a30b-fe5c3089e5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:03.076085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc127f-93d8-4778-a30b-fe5c3089e5f9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:03.079805 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8a95-e8df-4d12-bbbb-1c8935b008cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:03.080418 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8a95-e8df-4d12-bbbb-1c8935b008cb service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:03.080736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8a95-e8df-4d12-bbbb-1c8935b008cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:03.081011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8a95-e8df-4d12-bbbb-1c8935b008cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:03.146435 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd8a95-e8df-4d12-bbbb-1c8935b008cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:03.147767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd8a95-e8df-4d12-bbbb-1c8935b008cb service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:03.157494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 815/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:03.781783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7410eb-7e2b-4804-b68f-22d64b320bcb service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:03.793939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7410eb-7e2b-4804-b68f-22d64b320bcb service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:03.798273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c1178-b33e-402b-a1d0-176f9ce44afc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:03.798900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c1178-b33e-402b-a1d0-176f9ce44afc service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:03.799364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c1178-b33e-402b-a1d0-176f9ce44afc service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:03.799646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c1178-b33e-402b-a1d0-176f9ce44afc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:03.812685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c1178-b33e-402b-a1d0-176f9ce44afc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:03.814120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c1178-b33e-402b-a1d0-176f9ce44afc service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:03.824952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 822/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:07.888528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8a95-e8df-4d12-bbbb-1c8935b008cb service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:07.946484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:07.964947 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8a95-e8df-4d12-bbbb-1c8935b008cb service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:07.970009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:07.972618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:07.973356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:07.973356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] PATH_INFO: `/v3/users/d94cf7f8672a45fb8e264a932e2a11d5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:07.974725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94cf7f8672a45fb8e264a932e2a11d5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:07.976779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:08.052497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94cf7f8672a45fb8e264a932e2a11d5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:08.053473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94cf7f8672a45fb8e264a932e2a11d5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:08.062580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94cf7f8672a45fb8e264a932e2a11d5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:08.063656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94cf7f8672a45fb8e264a932e2a11d5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:08.077184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94cf7f8672a45fb8e264a932e2a11d5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:08.095837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 816/1638] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:07 2022] DELETE /identity/v3/users/d94cf7f8672a45fb8e264a932e2a11d5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:08.100398 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178a89b-bccd-461a-ad53-af133d7afaa4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:08.100923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178a89b-bccd-461a-ad53-af133d7afaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:08.101010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178a89b-bccd-461a-ad53-af133d7afaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:08.133441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9178a89b-bccd-461a-ad53-af133d7afaa4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:08.134679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9178a89b-bccd-461a-ad53-af133d7afaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:08.252663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 823/1639] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:08.262467 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:08.264000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:08.401037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb2367-5c8d-4483-a6a8-d4c15b5e25a7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:08.409796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee1c29-7f49-452b-aa26-74409cf53d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:08.409796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee1c29-7f49-452b-aa26-74409cf53d33 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:08.409796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee1c29-7f49-452b-aa26-74409cf53d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:08.410296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee1c29-7f49-452b-aa26-74409cf53d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:08.426222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee1c29-7f49-452b-aa26-74409cf53d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:08.427807 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee1c29-7f49-452b-aa26-74409cf53d33 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:08.451556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 817/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:09.015647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178a89b-bccd-461a-ad53-af133d7afaa4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:09.017135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9178a89b-bccd-461a-ad53-af133d7afaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:09.031795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178a89b-bccd-461a-ad53-af133d7afaa4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:09.062522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:09.063407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:09.063921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:09.064316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] PATH_INFO: `/v3/projects/57b8dfc996ee4d1299e50dc172cbfb38` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:09.065646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b8dfc996ee4d1299e50dc172cbfb38)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:09.068574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:09.136255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b8dfc996ee4d1299e50dc172cbfb38', 'request_id': 'req-37b7a6ce-0aba-40d9-a088-35d30643a566'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:09.146903 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b8dfc996ee4d1299e50dc172cbfb38', 'request_id': 'req-37b7a6ce-0aba-40d9-a088-35d30643a566'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:09.154853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b8dfc996ee4d1299e50dc172cbfb38', 'request_id': 'req-37b7a6ce-0aba-40d9-a088-35d30643a566'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:09.168303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] The token cache is being invalidate because project 57b8dfc996ee4d1299e50dc172cbfb38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:09.168632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:09.169267 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:09.170773 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 824/1641] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:09 2022] DELETE /identity/v3/projects/57b8dfc996ee4d1299e50dc172cbfb38 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:09.175056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee1c29-7f49-452b-aa26-74409cf53d33 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:09.185765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee1c29-7f49-452b-aa26-74409cf53d33 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:09.261082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85657796-abda-454b-be45-646952e01996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:09.261740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85657796-abda-454b-be45-646952e01996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:09.262025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85657796-abda-454b-be45-646952e01996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:09.262301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85657796-abda-454b-be45-646952e01996 admin admin] PATH_INFO: `/v3/users/93ad09a651634c8aacc54847b2895b63` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:09.263606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85657796-abda-454b-be45-646952e01996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ad09a651634c8aacc54847b2895b63)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:09.265744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85657796-abda-454b-be45-646952e01996 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:09.298476 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:09.379473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-85657796-abda-454b-be45-646952e01996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ad09a651634c8aacc54847b2895b63'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:09.380190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-85657796-abda-454b-be45-646952e01996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ad09a651634c8aacc54847b2895b63'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:09.392692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-85657796-abda-454b-be45-646952e01996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ad09a651634c8aacc54847b2895b63'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:09.393794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-85657796-abda-454b-be45-646952e01996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ad09a651634c8aacc54847b2895b63'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:09.408322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-85657796-abda-454b-be45-646952e01996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ad09a651634c8aacc54847b2895b63'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:09.423740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 818/1642] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:09 2022] DELETE /identity/v3/users/93ad09a651634c8aacc54847b2895b63 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:09.872539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:09.874327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:09.900658 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7a6ce-0aba-40d9-a088-35d30643a566 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:09.977800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:09.978658 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:09.978941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:09.979219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] PATH_INFO: `/v3/projects/592a6f6293e74f11ab7eebd111790dee` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:09.980432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] RBAC: Authorizing `identity:delete_project(project_id=592a6f6293e74f11ab7eebd111790dee)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:09.982492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:10.000158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:10.064156 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592a6f6293e74f11ab7eebd111790dee', 'request_id': 'req-60a5a457-8e8d-44bb-a300-55b8d6c6185f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:10.072572 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592a6f6293e74f11ab7eebd111790dee', 'request_id': 'req-60a5a457-8e8d-44bb-a300-55b8d6c6185f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:10.086430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592a6f6293e74f11ab7eebd111790dee', 'request_id': 'req-60a5a457-8e8d-44bb-a300-55b8d6c6185f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:10.100792 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] The token cache is being invalidate because project 592a6f6293e74f11ab7eebd111790dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:10.101215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:10.102926 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:10.104922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 825/1643] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:09 2022] DELETE /identity/v3/projects/592a6f6293e74f11ab7eebd111790dee => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:10.108859 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85657796-abda-454b-be45-646952e01996 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:10.110391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-85657796-abda-454b-be45-646952e01996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:10.126787 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85657796-abda-454b-be45-646952e01996 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:10.197259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:10.197921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:10.198072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:10.198340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] PATH_INFO: `/v3/users/fbc0c812cac94f54a7714d034f91b40f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:10.199479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc0c812cac94f54a7714d034f91b40f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:10.201538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:10.261789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc0c812cac94f54a7714d034f91b40f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:10.262548 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc0c812cac94f54a7714d034f91b40f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:10.269964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc0c812cac94f54a7714d034f91b40f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:10.270671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc0c812cac94f54a7714d034f91b40f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:10.282677 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-056ddcfb-3b93-43cc-ac0b-d7749d9df5bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc0c812cac94f54a7714d034f91b40f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:10.300563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 819/1644] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:10 2022] DELETE /identity/v3/users/fbc0c812cac94f54a7714d034f91b40f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:10.885331 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:10.886822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:10.901870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5a457-8e8d-44bb-a300-55b8d6c6185f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:10.965649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:10.966300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:10.966584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:10.966892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] PATH_INFO: `/v3/projects/94dc2bea5cb142f39c43fe5d01c9274a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:10.968139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] RBAC: Authorizing `identity:delete_project(project_id=94dc2bea5cb142f39c43fe5d01c9274a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:10.970081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:11.028161 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94dc2bea5cb142f39c43fe5d01c9274a', 'request_id': 'req-b36e1e46-f29a-4141-985c-0af9b389737f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:11.035594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94dc2bea5cb142f39c43fe5d01c9274a', 'request_id': 'req-b36e1e46-f29a-4141-985c-0af9b389737f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:11.042774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94dc2bea5cb142f39c43fe5d01c9274a', 'request_id': 'req-b36e1e46-f29a-4141-985c-0af9b389737f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:11.058888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] The token cache is being invalidate because project 94dc2bea5cb142f39c43fe5d01c9274a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:11.059311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:11.059880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b36e1e46-f29a-4141-985c-0af9b389737f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:11.061800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 826/1645] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:10 2022] DELETE /identity/v3/projects/94dc2bea5cb142f39c43fe5d01c9274a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:11.067150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03e4b4-a759-4799-aebe-0c1f313fbd3c None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:11.067446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03e4b4-a759-4799-aebe-0c1f313fbd3c None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:11.067732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03e4b4-a759-4799-aebe-0c1f313fbd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:11.081465 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:11.103478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5b03e4b4-a759-4799-aebe-0c1f313fbd3c None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:11.107260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5b03e4b4-a759-4799-aebe-0c1f313fbd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:11.233735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 820/1646] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:11.235711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854699c1-552a-4f2d-b9e8-2a051aff390d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:11.235974 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854699c1-552a-4f2d-b9e8-2a051aff390d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:11.236294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854699c1-552a-4f2d-b9e8-2a051aff390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:11.273866 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-854699c1-552a-4f2d-b9e8-2a051aff390d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:11.276164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-854699c1-552a-4f2d-b9e8-2a051aff390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:11.287235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 827/1647] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:11.291108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03e4b4-a759-4799-aebe-0c1f313fbd3c None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:11.308732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03e4b4-a759-4799-aebe-0c1f313fbd3c None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:11.319049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf5a16-57d2-4e91-a677-44297a3bda36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:11.319049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf5a16-57d2-4e91-a677-44297a3bda36 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:11.319049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf5a16-57d2-4e91-a677-44297a3bda36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:11.319049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf5a16-57d2-4e91-a677-44297a3bda36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:11.319360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf5a16-57d2-4e91-a677-44297a3bda36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:11.319360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf5a16-57d2-4e91-a677-44297a3bda36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:11.320602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf5a16-57d2-4e91-a677-44297a3bda36 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:11.335940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 821/1648] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:35:11.340566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854699c1-552a-4f2d-b9e8-2a051aff390d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:11.355579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854699c1-552a-4f2d-b9e8-2a051aff390d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:11.366132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712783-b600-4b2c-85ce-d31321213bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:11.367490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712783-b600-4b2c-85ce-d31321213bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:11.367785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712783-b600-4b2c-85ce-d31321213bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:11.368070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712783-b600-4b2c-85ce-d31321213bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:11.369190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d712783-b600-4b2c-85ce-d31321213bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:11.371121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d712783-b600-4b2c-85ce-d31321213bb4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:11.406304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 828/1649] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:11 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:11.410099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf5a16-57d2-4e91-a677-44297a3bda36 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:11.423922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf5a16-57d2-4e91-a677-44297a3bda36 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:11.509045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec11b03-c74d-47cc-bd39-c668e4c9874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:11.509701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11b03-c74d-47cc-bd39-c668e4c9874a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:11.509986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11b03-c74d-47cc-bd39-c668e4c9874a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:11.510260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11b03-c74d-47cc-bd39-c668e4c9874a admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:11.510913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec11b03-c74d-47cc-bd39-c668e4c9874a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:11.513032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec11b03-c74d-47cc-bd39-c668e4c9874a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:11.540507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 822/1650] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:11 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:35:11.543419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712783-b600-4b2c-85ce-d31321213bb4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:11.549960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:11.557078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712783-b600-4b2c-85ce-d31321213bb4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:11.565439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3e086-a0b6-40bf-9140-19e939eb446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:11.566218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e086-a0b6-40bf-9140-19e939eb446a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:11.567856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e086-a0b6-40bf-9140-19e939eb446a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:11.568213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e086-a0b6-40bf-9140-19e939eb446a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:11.569026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3e086-a0b6-40bf-9140-19e939eb446a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:11.570707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3e086-a0b6-40bf-9140-19e939eb446a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:11.583228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 829/1651] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:11.586847 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec11b03-c74d-47cc-bd39-c668e4c9874a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:11.597278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec11b03-c74d-47cc-bd39-c668e4c9874a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:11.602333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5587a2-f1b4-4393-a2bb-79d6ef74205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:11.603034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5587a2-f1b4-4393-a2bb-79d6ef74205a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:11.603393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5587a2-f1b4-4393-a2bb-79d6ef74205a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:11.603766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5587a2-f1b4-4393-a2bb-79d6ef74205a admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:11.604544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5587a2-f1b4-4393-a2bb-79d6ef74205a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:11.606786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5587a2-f1b4-4393-a2bb-79d6ef74205a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:11.619554 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 823/1652] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:11.623828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3e086-a0b6-40bf-9140-19e939eb446a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:11.636946 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3e086-a0b6-40bf-9140-19e939eb446a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:11.642217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243f97-99b7-4f65-b746-0eb21f96a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:11.643234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243f97-99b7-4f65-b746-0eb21f96a93c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:11.643234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243f97-99b7-4f65-b746-0eb21f96a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:11.643448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243f97-99b7-4f65-b746-0eb21f96a93c admin admin] PATH_INFO: `/v3/projects/5ab2bf048eb54b2e941e616f644c7bc0/users/535409073a004b98ae95c26461f7d32b/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:11.662173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243f97-99b7-4f65-b746-0eb21f96a93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab2bf048eb54b2e941e616f644c7bc0, user_id=535409073a004b98ae95c26461f7d32b, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:11.664925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243f97-99b7-4f65-b746-0eb21f96a93c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:11.681109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 830/1653] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:11 2022] PUT /identity/v3/projects/5ab2bf048eb54b2e941e616f644c7bc0/users/535409073a004b98ae95c26461f7d32b/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:11.693112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16e605-d28e-433f-874b-21501915f0fc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:11.693408 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16e605-d28e-433f-874b-21501915f0fc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:11.693692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16e605-d28e-433f-874b-21501915f0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:11.730745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5c16e605-d28e-433f-874b-21501915f0fc None None] MFA Rules not processed for user `535409073a004b98ae95c26461f7d32b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:11.732042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5c16e605-d28e-433f-874b-21501915f0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:11.806604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 824/1654] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:11.817551 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243f97-99b7-4f65-b746-0eb21f96a93c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:11.819903 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d2243f97-99b7-4f65-b746-0eb21f96a93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:11.928397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243f97-99b7-4f65-b746-0eb21f96a93c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:11.932454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04b98a-e233-48ce-b598-2d20b60b13cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:11.933126 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04b98a-e233-48ce-b598-2d20b60b13cb service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:11.933447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04b98a-e233-48ce-b598-2d20b60b13cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:11.933721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04b98a-e233-48ce-b598-2d20b60b13cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:11.942698 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04b98a-e233-48ce-b598-2d20b60b13cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:11.944131 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04b98a-e233-48ce-b598-2d20b60b13cb service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:11.953184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 831/1655] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:13.331085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f37a0-d90f-4028-a112-f5badce3b244 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:13.331621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f37a0-d90f-4028-a112-f5badce3b244 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:13.334653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f37a0-d90f-4028-a112-f5badce3b244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:13.343650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:13.358781 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-485f37a0-d90f-4028-a112-f5badce3b244 None None] MFA Rules not processed for user `535409073a004b98ae95c26461f7d32b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:13.360560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-485f37a0-d90f-4028-a112-f5badce3b244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:13.379788 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 825/1656] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:13.604140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04b98a-e233-48ce-b598-2d20b60b13cb service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:13.606114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a04b98a-e233-48ce-b598-2d20b60b13cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:13.624059 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04b98a-e233-48ce-b598-2d20b60b13cb service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:13.628134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b581-eed6-4a93-9767-6ad1be1fa9e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:13.629407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b581-eed6-4a93-9767-6ad1be1fa9e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:13.629801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b581-eed6-4a93-9767-6ad1be1fa9e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:13.630239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b581-eed6-4a93-9767-6ad1be1fa9e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:13.634345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1ac9b581-eed6-4a93-9767-6ad1be1fa9e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:13.736747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9b581-eed6-4a93-9767-6ad1be1fa9e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:13.739596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9b581-eed6-4a93-9767-6ad1be1fa9e4 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:13.766895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 832/1657] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:19.905759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f37a0-d90f-4028-a112-f5badce3b244 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:19.907631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-485f37a0-d90f-4028-a112-f5badce3b244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:19.989708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f37a0-d90f-4028-a112-f5badce3b244 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:19.995007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:19.995757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:19.996040 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:19.996308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] PATH_INFO: `/v3/users/962b2af5884f493bb3ea707735fdb431` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:19.997485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=962b2af5884f493bb3ea707735fdb431)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:19.999423 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:20.057194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '962b2af5884f493bb3ea707735fdb431'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:20.058488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '962b2af5884f493bb3ea707735fdb431'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:20.068259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '962b2af5884f493bb3ea707735fdb431'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:20.069002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '962b2af5884f493bb3ea707735fdb431'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:20.087014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ebb41764-9f3f-44eb-9cf3-5fc535bf2c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '962b2af5884f493bb3ea707735fdb431'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:20.100499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 826/1658] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:19 2022] DELETE /identity/v3/users/962b2af5884f493bb3ea707735fdb431 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:20.451985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b581-eed6-4a93-9767-6ad1be1fa9e4 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:20.463070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b581-eed6-4a93-9767-6ad1be1fa9e4 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:20.537777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:20.538446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:20.538726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:20.538998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] PATH_INFO: `/v3/projects/8bd9b14312e84c35b017afb82ed9e06f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:20.540143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd9b14312e84c35b017afb82ed9e06f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:20.542125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:20.548837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:20.594943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd9b14312e84c35b017afb82ed9e06f', 'request_id': 'req-759782da-da7d-4e8b-a2d1-ef5705dccc0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:20.601310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd9b14312e84c35b017afb82ed9e06f', 'request_id': 'req-759782da-da7d-4e8b-a2d1-ef5705dccc0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:20.608420 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd9b14312e84c35b017afb82ed9e06f', 'request_id': 'req-759782da-da7d-4e8b-a2d1-ef5705dccc0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:20.623561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] The token cache is being invalidate because project 8bd9b14312e84c35b017afb82ed9e06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:20.623852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:20.624530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-759782da-da7d-4e8b-a2d1-ef5705dccc0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:20.626251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 833/1659] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:20 2022] DELETE /identity/v3/projects/8bd9b14312e84c35b017afb82ed9e06f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:20.631688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898169e-c6a9-4249-9178-d9d45c8f9bad None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:20.631917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898169e-c6a9-4249-9178-d9d45c8f9bad None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:20.632198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898169e-c6a9-4249-9178-d9d45c8f9bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:20.651745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f898169e-c6a9-4249-9178-d9d45c8f9bad None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:20.653044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f898169e-c6a9-4249-9178-d9d45c8f9bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:20.718195 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 827/1660] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:20.726744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2d86-a8c2-4298-bed1-da819dcaf0b6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:20.727141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2d86-a8c2-4298-bed1-da819dcaf0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:20.727511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2d86-a8c2-4298-bed1-da819dcaf0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:20.747822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-31be2d86-a8c2-4298-bed1-da819dcaf0b6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:20.749196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-31be2d86-a8c2-4298-bed1-da819dcaf0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:20.757964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 834/1661] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:35:20.762134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898169e-c6a9-4249-9178-d9d45c8f9bad None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:20.772494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898169e-c6a9-4249-9178-d9d45c8f9bad None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:20.778086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bf49f-c875-488b-9685-e5e9a39944c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:20.778745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf49f-c875-488b-9685-e5e9a39944c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:20.779026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf49f-c875-488b-9685-e5e9a39944c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:20.779307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf49f-c875-488b-9685-e5e9a39944c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:20.779964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bf49f-c875-488b-9685-e5e9a39944c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:20.780268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bf49f-c875-488b-9685-e5e9a39944c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:20.782100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bf49f-c875-488b-9685-e5e9a39944c6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:20.797383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 828/1662] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:35:20.802124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2d86-a8c2-4298-bed1-da819dcaf0b6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:20.811604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2d86-a8c2-4298-bed1-da819dcaf0b6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:20.816612 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75071b1d-c6d9-455d-a099-952feedb431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:20.816989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75071b1d-c6d9-455d-a099-952feedb431a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:20.817272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75071b1d-c6d9-455d-a099-952feedb431a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:20.817545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75071b1d-c6d9-455d-a099-952feedb431a admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:20.818176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75071b1d-c6d9-455d-a099-952feedb431a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:20.821027 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75071b1d-c6d9-455d-a099-952feedb431a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:20.852316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 835/1663] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:20 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:20.854206 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bf49f-c875-488b-9685-e5e9a39944c6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:20.859382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:20.866792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bf49f-c875-488b-9685-e5e9a39944c6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:20.922940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbfd1a-015e-46d2-86be-1b947b1e85ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:20.923639 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbfd1a-015e-46d2-86be-1b947b1e85ca admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:20.923734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbfd1a-015e-46d2-86be-1b947b1e85ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:20.923985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbfd1a-015e-46d2-86be-1b947b1e85ca admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:20.924635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbfd1a-015e-46d2-86be-1b947b1e85ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:20.927241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbfd1a-015e-46d2-86be-1b947b1e85ca admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:20.948087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 829/1664] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:20 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:20.952228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75071b1d-c6d9-455d-a099-952feedb431a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:20.963314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75071b1d-c6d9-455d-a099-952feedb431a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:20.968104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9d1e-9bcd-4554-beed-4213e2afe74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:20.968741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9d1e-9bcd-4554-beed-4213e2afe74a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:20.969027 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9d1e-9bcd-4554-beed-4213e2afe74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:20.969305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9d1e-9bcd-4554-beed-4213e2afe74a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:20.969955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f9d1e-9bcd-4554-beed-4213e2afe74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:20.971540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f9d1e-9bcd-4554-beed-4213e2afe74a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:20.982223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 836/1665] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:20.986364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbfd1a-015e-46d2-86be-1b947b1e85ca admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:20.997333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbfd1a-015e-46d2-86be-1b947b1e85ca admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:21.002321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df077a98-20b9-4ed3-b5af-71a09429999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:21.002934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df077a98-20b9-4ed3-b5af-71a09429999d admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:21.003218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df077a98-20b9-4ed3-b5af-71a09429999d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:21.003577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df077a98-20b9-4ed3-b5af-71a09429999d admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:21.004949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df077a98-20b9-4ed3-b5af-71a09429999d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:21.006566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df077a98-20b9-4ed3-b5af-71a09429999d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:21.017688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 830/1666] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:21.022416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9d1e-9bcd-4554-beed-4213e2afe74a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:21.032743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9d1e-9bcd-4554-beed-4213e2afe74a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:21.038638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0b22c-4a26-4cd0-8694-2c95e18c6f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:21.039316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0b22c-4a26-4cd0-8694-2c95e18c6f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:21.039602 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0b22c-4a26-4cd0-8694-2c95e18c6f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:21.039883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0b22c-4a26-4cd0-8694-2c95e18c6f89 admin admin] PATH_INFO: `/v3/projects/9f3be4945a9d4a418bd5889068fbcdbc/users/85e7237950fd4cc995e060b47efed22e/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:21.056833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0b22c-4a26-4cd0-8694-2c95e18c6f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3be4945a9d4a418bd5889068fbcdbc, user_id=85e7237950fd4cc995e060b47efed22e, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:21.059533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0b22c-4a26-4cd0-8694-2c95e18c6f89 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:21.073455 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 837/1667] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:21 2022] PUT /identity/v3/projects/9f3be4945a9d4a418bd5889068fbcdbc/users/85e7237950fd4cc995e060b47efed22e/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:21.084215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a07d-9997-4e0b-9b32-f92a3eb386c0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:21.084534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a07d-9997-4e0b-9b32-f92a3eb386c0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:21.084838 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a07d-9997-4e0b-9b32-f92a3eb386c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:21.118806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3137a07d-9997-4e0b-9b32-f92a3eb386c0 None None] MFA Rules not processed for user `85e7237950fd4cc995e060b47efed22e`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:21.120016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3137a07d-9997-4e0b-9b32-f92a3eb386c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:21.182557 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 831/1668] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:35:21.194371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0b22c-4a26-4cd0-8694-2c95e18c6f89 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:21.196048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f2c0b22c-4a26-4cd0-8694-2c95e18c6f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:21.271430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0b22c-4a26-4cd0-8694-2c95e18c6f89 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:21.277045 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8a329-239d-4573-9853-914d67cf1ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:21.277659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8a329-239d-4573-9853-914d67cf1ca1 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:21.277996 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8a329-239d-4573-9853-914d67cf1ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:21.278293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8a329-239d-4573-9853-914d67cf1ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:21.286538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8a329-239d-4573-9853-914d67cf1ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:21.288109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8a329-239d-4573-9853-914d67cf1ca1 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:21.297533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 838/1669] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:21.514642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137a07d-9997-4e0b-9b32-f92a3eb386c0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:21.581063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137a07d-9997-4e0b-9b32-f92a3eb386c0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:21.586223 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:21.586859 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:21.587141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:21.587415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] PATH_INFO: `/v3/users/85e7237950fd4cc995e060b47efed22e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:21.588618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e7237950fd4cc995e060b47efed22e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:21.590754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:21.605171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:21.646400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e7237950fd4cc995e060b47efed22e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:21.648745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e7237950fd4cc995e060b47efed22e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:21.659372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e7237950fd4cc995e060b47efed22e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:21.660220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e7237950fd4cc995e060b47efed22e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:21.673184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e7237950fd4cc995e060b47efed22e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:21.694411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 832/1670] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:21 2022] DELETE /identity/v3/users/85e7237950fd4cc995e060b47efed22e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:21.699624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fa29d-3ddc-4382-b2bb-6f8f98e627bf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:21.700278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fa29d-3ddc-4382-b2bb-6f8f98e627bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:21.700278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fa29d-3ddc-4382-b2bb-6f8f98e627bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:21.720330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6e1fa29d-3ddc-4382-b2bb-6f8f98e627bf None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:21.721637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6e1fa29d-3ddc-4382-b2bb-6f8f98e627bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:21.732449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:21.791014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 839/1671] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:21.802059 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:21.803533 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:21.862063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03098eec-6376-4277-9b39-0e285a5bc5ef admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:21.866610 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef78d2-43af-4e2d-82d9-f3557775a085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:21.867221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef78d2-43af-4e2d-82d9-f3557775a085 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:21.867502 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef78d2-43af-4e2d-82d9-f3557775a085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:21.867774 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef78d2-43af-4e2d-82d9-f3557775a085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:21.876652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef78d2-43af-4e2d-82d9-f3557775a085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:21.878076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef78d2-43af-4e2d-82d9-f3557775a085 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:21.887613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 833/1672] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:22.157244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fa29d-3ddc-4382-b2bb-6f8f98e627bf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:22.158690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6e1fa29d-3ddc-4382-b2bb-6f8f98e627bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:22.173397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fa29d-3ddc-4382-b2bb-6f8f98e627bf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:22.178882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:22.179522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.179802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.180072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] PATH_INFO: `/v3/projects/9f3be4945a9d4a418bd5889068fbcdbc` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.181218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3be4945a9d4a418bd5889068fbcdbc)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:22.183268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:22.240513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3be4945a9d4a418bd5889068fbcdbc', 'request_id': 'req-c774604b-30a7-41d3-98d4-56cbb0ef67da'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:22.246113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3be4945a9d4a418bd5889068fbcdbc', 'request_id': 'req-c774604b-30a7-41d3-98d4-56cbb0ef67da'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:22.252710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3be4945a9d4a418bd5889068fbcdbc', 'request_id': 'req-c774604b-30a7-41d3-98d4-56cbb0ef67da'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:22.266062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] The token cache is being invalidate because project 9f3be4945a9d4a418bd5889068fbcdbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:22.266355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:22.266993 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c774604b-30a7-41d3-98d4-56cbb0ef67da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:22.268524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 840/1673] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:22 2022] DELETE /identity/v3/projects/9f3be4945a9d4a418bd5889068fbcdbc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:22.274035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bbe3d-8825-4638-b25f-54bf231c5931 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.274489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bbe3d-8825-4638-b25f-54bf231c5931 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.274613 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bbe3d-8825-4638-b25f-54bf231c5931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.294940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4d9bbe3d-8825-4638-b25f-54bf231c5931 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:22.296192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4d9bbe3d-8825-4638-b25f-54bf231c5931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:22.355341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 834/1674] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:35:22.363989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc793f7-ac78-4809-865a-b01a39a79dc5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.364419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc793f7-ac78-4809-865a-b01a39a79dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.364727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc793f7-ac78-4809-865a-b01a39a79dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.384883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6cc793f7-ac78-4809-865a-b01a39a79dc5 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:22.386091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6cc793f7-ac78-4809-865a-b01a39a79dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:22.395184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 841/1675] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:22.399196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bbe3d-8825-4638-b25f-54bf231c5931 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:22.409406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bbe3d-8825-4638-b25f-54bf231c5931 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:22.414764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70156-ede5-412b-83a1-6da24bd0a888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:22.415378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70156-ede5-412b-83a1-6da24bd0a888 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.415661 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70156-ede5-412b-83a1-6da24bd0a888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.415938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70156-ede5-412b-83a1-6da24bd0a888 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.416626 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70156-ede5-412b-83a1-6da24bd0a888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:22.416938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70156-ede5-412b-83a1-6da24bd0a888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:22.418535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70156-ede5-412b-83a1-6da24bd0a888 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:22.434011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 835/1676] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:35:22.435079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc793f7-ac78-4809-865a-b01a39a79dc5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:22.444667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc793f7-ac78-4809-865a-b01a39a79dc5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:22.452233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd90fbe-1d24-4baa-ae6b-238ff179f3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:22.452876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd90fbe-1d24-4baa-ae6b-238ff179f3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.453157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd90fbe-1d24-4baa-ae6b-238ff179f3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.453450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd90fbe-1d24-4baa-ae6b-238ff179f3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.454067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd90fbe-1d24-4baa-ae6b-238ff179f3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:22.455971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd90fbe-1d24-4baa-ae6b-238ff179f3d7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:22.485722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 842/1677] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:22 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:22.490477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70156-ede5-412b-83a1-6da24bd0a888 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:22.501034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70156-ede5-412b-83a1-6da24bd0a888 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:22.520919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:22.565372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ae852-d98f-4495-8c63-b9bdd4f57950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:22.566086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ae852-d98f-4495-8c63-b9bdd4f57950 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.566368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ae852-d98f-4495-8c63-b9bdd4f57950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.566638 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ae852-d98f-4495-8c63-b9bdd4f57950 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.567359 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ae852-d98f-4495-8c63-b9bdd4f57950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:22.569229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ae852-d98f-4495-8c63-b9bdd4f57950 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:22.591657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 836/1678] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:22 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:22.595893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd90fbe-1d24-4baa-ae6b-238ff179f3d7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:22.606545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd90fbe-1d24-4baa-ae6b-238ff179f3d7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:22.611101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180d0dc-1f16-4263-91ed-054bb55c9035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:22.611690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180d0dc-1f16-4263-91ed-054bb55c9035 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.611967 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180d0dc-1f16-4263-91ed-054bb55c9035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.612536 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180d0dc-1f16-4263-91ed-054bb55c9035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.613879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180d0dc-1f16-4263-91ed-054bb55c9035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:22.615450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180d0dc-1f16-4263-91ed-054bb55c9035 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:22.625312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 843/1679] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:22.629239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ae852-d98f-4495-8c63-b9bdd4f57950 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:22.639041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ae852-d98f-4495-8c63-b9bdd4f57950 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:22.643545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66e294-58e7-4470-9de0-757cfb955077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:22.644159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66e294-58e7-4470-9de0-757cfb955077 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.644438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66e294-58e7-4470-9de0-757cfb955077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.644753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66e294-58e7-4470-9de0-757cfb955077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.645371 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66e294-58e7-4470-9de0-757cfb955077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:22.646996 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66e294-58e7-4470-9de0-757cfb955077 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:22.657485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 837/1680] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:22.662282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180d0dc-1f16-4263-91ed-054bb55c9035 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:22.672290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180d0dc-1f16-4263-91ed-054bb55c9035 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:22.677643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06250a2-dd50-41e2-8635-fa60327ce149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:22.678280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06250a2-dd50-41e2-8635-fa60327ce149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.678559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06250a2-dd50-41e2-8635-fa60327ce149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.678828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06250a2-dd50-41e2-8635-fa60327ce149 admin admin] PATH_INFO: `/v3/projects/782b67e2cbc742da929fdc09b195b6de/users/166f130e45114d4d91f860068203e095/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.693527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06250a2-dd50-41e2-8635-fa60327ce149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782b67e2cbc742da929fdc09b195b6de, user_id=166f130e45114d4d91f860068203e095, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:22.696186 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06250a2-dd50-41e2-8635-fa60327ce149 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:22.708750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 844/1681] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:22 2022] PUT /identity/v3/projects/782b67e2cbc742da929fdc09b195b6de/users/166f130e45114d4d91f860068203e095/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:22.718916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a7b9-e274-4aed-a809-954f44d37bc8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.719231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a7b9-e274-4aed-a809-954f44d37bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.719507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a7b9-e274-4aed-a809-954f44d37bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.747987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8f72a7b9-e274-4aed-a809-954f44d37bc8 None None] MFA Rules not processed for user `166f130e45114d4d91f860068203e095`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:22.749152 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8f72a7b9-e274-4aed-a809-954f44d37bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:22.821571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 838/1682] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:22.825957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06250a2-dd50-41e2-8635-fa60327ce149 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:22.868936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:22.899217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06250a2-dd50-41e2-8635-fa60327ce149 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:22.903888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebacd7-3224-4a52-b4e0-e9beebdd07ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:22.904535 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebacd7-3224-4a52-b4e0-e9beebdd07ea admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:22.904818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebacd7-3224-4a52-b4e0-e9beebdd07ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:22.905092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebacd7-3224-4a52-b4e0-e9beebdd07ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:22.905721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebacd7-3224-4a52-b4e0-e9beebdd07ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:22.907596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebacd7-3224-4a52-b4e0-e9beebdd07ea admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:22.934836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 845/1683] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:22 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:22.938881 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a7b9-e274-4aed-a809-954f44d37bc8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:22.949852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a7b9-e274-4aed-a809-954f44d37bc8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:23.012436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d6bfb-7447-460a-8473-257205381b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:23.013160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d6bfb-7447-460a-8473-257205381b76 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:23.013514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d6bfb-7447-460a-8473-257205381b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:23.013860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d6bfb-7447-460a-8473-257205381b76 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:23.014593 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d6bfb-7447-460a-8473-257205381b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:23.016600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d6bfb-7447-460a-8473-257205381b76 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:23.043541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 839/1684] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:22 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:23.044748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebacd7-3224-4a52-b4e0-e9beebdd07ea admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:23.057232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebacd7-3224-4a52-b4e0-e9beebdd07ea admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:23.062076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb1cf-34c3-4bb3-af91-8c7b6c4d2ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:23.062714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb1cf-34c3-4bb3-af91-8c7b6c4d2ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:23.063023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb1cf-34c3-4bb3-af91-8c7b6c4d2ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:23.063303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb1cf-34c3-4bb3-af91-8c7b6c4d2ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:23.063951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeb1cf-34c3-4bb3-af91-8c7b6c4d2ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:23.065574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeb1cf-34c3-4bb3-af91-8c7b6c4d2ef4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:23.076685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 846/1685] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:35:23.080992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d6bfb-7447-460a-8473-257205381b76 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:23.091892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d6bfb-7447-460a-8473-257205381b76 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:23.096683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395e08-5bf7-4169-9b4b-56e9919380a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:23.098069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395e08-5bf7-4169-9b4b-56e9919380a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:23.098366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395e08-5bf7-4169-9b4b-56e9919380a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:23.098640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395e08-5bf7-4169-9b4b-56e9919380a5 admin admin] PATH_INFO: `/v3/projects/d672f3057f01444fa9b6f9d43fd6dbb2/users/197069490b994b8d9428b728136197c7/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:23.113707 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b395e08-5bf7-4169-9b4b-56e9919380a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d672f3057f01444fa9b6f9d43fd6dbb2, user_id=197069490b994b8d9428b728136197c7, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:23.116366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b395e08-5bf7-4169-9b4b-56e9919380a5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:23.118676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:23.130094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 840/1686] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:23 2022] PUT /identity/v3/projects/d672f3057f01444fa9b6f9d43fd6dbb2/users/197069490b994b8d9428b728136197c7/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:23.134028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb1cf-34c3-4bb3-af91-8c7b6c4d2ef4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:23.143740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb1cf-34c3-4bb3-af91-8c7b6c4d2ef4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:23.202153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5051336-e083-4e49-a326-b38d76ec067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:23.202964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5051336-e083-4e49-a326-b38d76ec067d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:23.203300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5051336-e083-4e49-a326-b38d76ec067d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:23.203705 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5051336-e083-4e49-a326-b38d76ec067d admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:23.204342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5051336-e083-4e49-a326-b38d76ec067d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:23.205987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5051336-e083-4e49-a326-b38d76ec067d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:23.216096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 847/1687] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:23.220386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395e08-5bf7-4169-9b4b-56e9919380a5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:23.232141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395e08-5bf7-4169-9b4b-56e9919380a5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:23.238647 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51316594-57e6-4316-b509-e9ab51a5db47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:23.239420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51316594-57e6-4316-b509-e9ab51a5db47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:23.239705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51316594-57e6-4316-b509-e9ab51a5db47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:23.239982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51316594-57e6-4316-b509-e9ab51a5db47 admin admin] PATH_INFO: `/v3/projects/d672f3057f01444fa9b6f9d43fd6dbb2/users/197069490b994b8d9428b728136197c7/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:23.242000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51316594-57e6-4316-b509-e9ab51a5db47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d672f3057f01444fa9b6f9d43fd6dbb2, user_id=197069490b994b8d9428b728136197c7, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:23.245067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51316594-57e6-4316-b509-e9ab51a5db47 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:23.256596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 841/1688] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:23 2022] PUT /identity/v3/projects/d672f3057f01444fa9b6f9d43fd6dbb2/users/197069490b994b8d9428b728136197c7/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:23.268008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aaa21-3889-4776-a431-c6eaff53c982 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:23.268328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aaa21-3889-4776-a431-c6eaff53c982 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:23.268657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aaa21-3889-4776-a431-c6eaff53c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:23.301167 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a32aaa21-3889-4776-a431-c6eaff53c982 None None] MFA Rules not processed for user `197069490b994b8d9428b728136197c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:23.302414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a32aaa21-3889-4776-a431-c6eaff53c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:23.387094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 848/1689] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:23.398292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51316594-57e6-4316-b509-e9ab51a5db47 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:23.400100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-51316594-57e6-4316-b509-e9ab51a5db47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:23.461902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51316594-57e6-4316-b509-e9ab51a5db47 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:23.465594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85a00f-8c43-43ac-870e-3a18718dc73f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:23.466197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85a00f-8c43-43ac-870e-3a18718dc73f service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:23.466476 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85a00f-8c43-43ac-870e-3a18718dc73f service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:23.466747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85a00f-8c43-43ac-870e-3a18718dc73f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:23.476508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85a00f-8c43-43ac-870e-3a18718dc73f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:23.477942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85a00f-8c43-43ac-870e-3a18718dc73f service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:23.489176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 842/1690] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:23.938728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32aaa21-3889-4776-a431-c6eaff53c982 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:23.974287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:24.004657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32aaa21-3889-4776-a431-c6eaff53c982 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:24.009284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:24.009914 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:24.010194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:24.010468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] PATH_INFO: `/v3/users/166f130e45114d4d91f860068203e095` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:24.011579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166f130e45114d4d91f860068203e095)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:24.013565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:24.065149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166f130e45114d4d91f860068203e095'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.065788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166f130e45114d4d91f860068203e095'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.073338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166f130e45114d4d91f860068203e095'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.084195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166f130e45114d4d91f860068203e095'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.084836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166f130e45114d4d91f860068203e095'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.103076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 849/1691] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:23 2022] DELETE /identity/v3/users/166f130e45114d4d91f860068203e095 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:24.107599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7eca6-932d-4075-9641-fb2ca64c9f2f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:24.107886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7eca6-932d-4075-9641-fb2ca64c9f2f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:24.108160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7eca6-932d-4075-9641-fb2ca64c9f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:24.129576 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9db7eca6-932d-4075-9641-fb2ca64c9f2f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:24.130813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9db7eca6-932d-4075-9641-fb2ca64c9f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:24.194008 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 843/1692] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:24.204787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:24.207717 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:24.268890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b08c0-27e1-4473-828e-814506b14882 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:24.273460 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7db13-e2fb-4d37-b70f-f0963ef65ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:24.274069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7db13-e2fb-4d37-b70f-f0963ef65ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:24.274347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7db13-e2fb-4d37-b70f-f0963ef65ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:24.274615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7db13-e2fb-4d37-b70f-f0963ef65ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:24.284211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7db13-e2fb-4d37-b70f-f0963ef65ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:24.286613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7db13-e2fb-4d37-b70f-f0963ef65ae1 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:24.311488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 850/1693] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:35:24.582355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7eca6-932d-4075-9641-fb2ca64c9f2f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:24.583934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9db7eca6-932d-4075-9641-fb2ca64c9f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:24.598100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7eca6-932d-4075-9641-fb2ca64c9f2f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:24.608937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:24.609829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:24.610106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:24.610523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] PATH_INFO: `/v3/projects/782b67e2cbc742da929fdc09b195b6de` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:24.611806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] RBAC: Authorizing `identity:delete_project(project_id=782b67e2cbc742da929fdc09b195b6de)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:24.614027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:24.668028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782b67e2cbc742da929fdc09b195b6de', 'request_id': 'req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.675896 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782b67e2cbc742da929fdc09b195b6de', 'request_id': 'req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.681814 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782b67e2cbc742da929fdc09b195b6de', 'request_id': 'req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.693723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] The token cache is being invalidate because project 782b67e2cbc742da929fdc09b195b6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:24.693971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.694618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.696211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 844/1694] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:24 2022] DELETE /identity/v3/projects/782b67e2cbc742da929fdc09b195b6de => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:24.700362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7db13-e2fb-4d37-b70f-f0963ef65ae1 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:24.710519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7db13-e2fb-4d37-b70f-f0963ef65ae1 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:24.774015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:24.783771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:24.784397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:24.784892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:24.785171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] PATH_INFO: `/v3/users/197069490b994b8d9428b728136197c7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:24.786297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=197069490b994b8d9428b728136197c7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:24.788245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:24.835719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197069490b994b8d9428b728136197c7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.836309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197069490b994b8d9428b728136197c7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.843326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197069490b994b8d9428b728136197c7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.851459 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197069490b994b8d9428b728136197c7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.852009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9bec6c9-e2fb-4ff2-845c-d4ea552b0b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197069490b994b8d9428b728136197c7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:24.870724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 851/1695] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:24 2022] DELETE /identity/v3/users/197069490b994b8d9428b728136197c7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:25.190098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:25.191678 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:25.205078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7f08d-f7c6-4d0d-9fdc-f6c2d84b141a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:25.209561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:25.269831 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:25.270559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:25.270844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:25.271144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] PATH_INFO: `/v3/projects/d672f3057f01444fa9b6f9d43fd6dbb2` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:25.272307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d672f3057f01444fa9b6f9d43fd6dbb2)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:25.274256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:25.319428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd672f3057f01444fa9b6f9d43fd6dbb2', 'request_id': 'req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:25.325887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd672f3057f01444fa9b6f9d43fd6dbb2', 'request_id': 'req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:25.331341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd672f3057f01444fa9b6f9d43fd6dbb2', 'request_id': 'req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:25.343180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] The token cache is being invalidate because project d672f3057f01444fa9b6f9d43fd6dbb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:25.343469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:25.344099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e8a93de-cd90-4100-a5a2-77311d4a4d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:25.345636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 845/1696] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:25 2022] DELETE /identity/v3/projects/d672f3057f01444fa9b6f9d43fd6dbb2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:25.351089 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c98d32-0093-4b61-9b95-37f75184079e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:25.351565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c98d32-0093-4b61-9b95-37f75184079e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:25.351653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c98d32-0093-4b61-9b95-37f75184079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:25.372815 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-75c98d32-0093-4b61-9b95-37f75184079e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:25.374027 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-75c98d32-0093-4b61-9b95-37f75184079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:25.436040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 852/1697] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:25.443853 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc8980-a4a4-47c8-b1ad-3b92d4ebc80b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:25.444198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc8980-a4a4-47c8-b1ad-3b92d4ebc80b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:25.444404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc8980-a4a4-47c8-b1ad-3b92d4ebc80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:25.465249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-25cc8980-a4a4-47c8-b1ad-3b92d4ebc80b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:25.466629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-25cc8980-a4a4-47c8-b1ad-3b92d4ebc80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:25.476128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 846/1698] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:25.480432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c98d32-0093-4b61-9b95-37f75184079e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:25.491056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c98d32-0093-4b61-9b95-37f75184079e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:25.495644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7754-7b43-45c9-b5d3-d011eb238df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:25.496320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7754-7b43-45c9-b5d3-d011eb238df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:25.496562 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7754-7b43-45c9-b5d3-d011eb238df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:25.496837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7754-7b43-45c9-b5d3-d011eb238df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:25.497484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb7754-7b43-45c9-b5d3-d011eb238df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:25.497786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb7754-7b43-45c9-b5d3-d011eb238df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:25.499373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb7754-7b43-45c9-b5d3-d011eb238df5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:25.511947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 853/1699] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:35:25.516360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc8980-a4a4-47c8-b1ad-3b92d4ebc80b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:25.526324 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc8980-a4a4-47c8-b1ad-3b92d4ebc80b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:25.533320 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad681e-f35c-4ed4-8049-4e19c43e300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:25.533920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad681e-f35c-4ed4-8049-4e19c43e300d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:25.534204 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad681e-f35c-4ed4-8049-4e19c43e300d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:25.534474 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad681e-f35c-4ed4-8049-4e19c43e300d admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:25.535256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad681e-f35c-4ed4-8049-4e19c43e300d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:25.537170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad681e-f35c-4ed4-8049-4e19c43e300d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:25.568319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 847/1700] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:25 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:25.572691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7754-7b43-45c9-b5d3-d011eb238df5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:25.584964 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7754-7b43-45c9-b5d3-d011eb238df5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:25.657516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c8371-deec-4296-9ec3-b8e61643ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:25.658224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c8371-deec-4296-9ec3-b8e61643ad49 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:25.658578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c8371-deec-4296-9ec3-b8e61643ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:25.658966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c8371-deec-4296-9ec3-b8e61643ad49 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:25.660194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c8371-deec-4296-9ec3-b8e61643ad49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:25.662195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c8371-deec-4296-9ec3-b8e61643ad49 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:25.670493 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:25.687282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 854/1701] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:25 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:25.691670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad681e-f35c-4ed4-8049-4e19c43e300d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:25.702004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad681e-f35c-4ed4-8049-4e19c43e300d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:25.706789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a3add-3d9f-4ebc-8e0f-6c0c6b280d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:25.707405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a3add-3d9f-4ebc-8e0f-6c0c6b280d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:25.707684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a3add-3d9f-4ebc-8e0f-6c0c6b280d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:25.707956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a3add-3d9f-4ebc-8e0f-6c0c6b280d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:25.708637 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a3add-3d9f-4ebc-8e0f-6c0c6b280d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:25.710235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a3add-3d9f-4ebc-8e0f-6c0c6b280d8e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:25.720520 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 848/1702] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:25.725445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c8371-deec-4296-9ec3-b8e61643ad49 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:25.735848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c8371-deec-4296-9ec3-b8e61643ad49 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:25.741529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe91a-9ab7-49d8-add9-a05b8d5acab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:25.742138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe91a-9ab7-49d8-add9-a05b8d5acab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:25.742436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe91a-9ab7-49d8-add9-a05b8d5acab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:25.742713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe91a-9ab7-49d8-add9-a05b8d5acab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:25.743381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fe91a-9ab7-49d8-add9-a05b8d5acab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:25.744995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fe91a-9ab7-49d8-add9-a05b8d5acab1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:25.756159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 855/1703] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:25.761163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a3add-3d9f-4ebc-8e0f-6c0c6b280d8e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:25.772631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a3add-3d9f-4ebc-8e0f-6c0c6b280d8e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:25.777797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc27afb-22f6-47a9-8faf-7222a3293043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:25.778571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc27afb-22f6-47a9-8faf-7222a3293043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:25.778964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc27afb-22f6-47a9-8faf-7222a3293043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:25.779332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc27afb-22f6-47a9-8faf-7222a3293043 admin admin] PATH_INFO: `/v3/projects/7b2c61e4413248ffbf33b77955953a45/users/53db02f820f74dcc97a21642eda8dc8e/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:25.800842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc27afb-22f6-47a9-8faf-7222a3293043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2c61e4413248ffbf33b77955953a45, user_id=53db02f820f74dcc97a21642eda8dc8e, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:25.804071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc27afb-22f6-47a9-8faf-7222a3293043 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:25.819992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 849/1704] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:25 2022] PUT /identity/v3/projects/7b2c61e4413248ffbf33b77955953a45/users/53db02f820f74dcc97a21642eda8dc8e/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:25.831504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bd3d8-2545-4444-ab1f-7215c1979fdc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:25.831818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bd3d8-2545-4444-ab1f-7215c1979fdc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:25.832068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bd3d8-2545-4444-ab1f-7215c1979fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:25.867523 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7a8bd3d8-2545-4444-ab1f-7215c1979fdc None None] MFA Rules not processed for user `53db02f820f74dcc97a21642eda8dc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:25.868941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a8bd3d8-2545-4444-ab1f-7215c1979fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:25.942484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 856/1705] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:25.946946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc27afb-22f6-47a9-8faf-7222a3293043 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:25.982017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:26.011475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc27afb-22f6-47a9-8faf-7222a3293043 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:26.016082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79c99-31ad-4a26-8403-19f59c5c9028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:26.016703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79c99-31ad-4a26-8403-19f59c5c9028 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:26.016984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79c99-31ad-4a26-8403-19f59c5c9028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:26.017254 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79c99-31ad-4a26-8403-19f59c5c9028 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:26.017882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede79c99-31ad-4a26-8403-19f59c5c9028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:26.020355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede79c99-31ad-4a26-8403-19f59c5c9028 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:26.046547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 850/1706] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:25 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:26.053923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bd3d8-2545-4444-ab1f-7215c1979fdc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:26.064829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bd3d8-2545-4444-ab1f-7215c1979fdc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:26.120557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bf413-9e0d-4824-8c26-994b20bdda48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:26.121163 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bf413-9e0d-4824-8c26-994b20bdda48 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:26.121439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bf413-9e0d-4824-8c26-994b20bdda48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:26.121707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bf413-9e0d-4824-8c26-994b20bdda48 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:26.122322 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bf413-9e0d-4824-8c26-994b20bdda48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:26.124215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bf413-9e0d-4824-8c26-994b20bdda48 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:26.148170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 857/1707] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:26 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:26.149450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79c99-31ad-4a26-8403-19f59c5c9028 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:26.161231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79c99-31ad-4a26-8403-19f59c5c9028 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:26.166160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f2c2-0cb1-4be6-8556-1e8f0b1747aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:26.166838 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f2c2-0cb1-4be6-8556-1e8f0b1747aa admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:26.167123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f2c2-0cb1-4be6-8556-1e8f0b1747aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:26.167394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f2c2-0cb1-4be6-8556-1e8f0b1747aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:26.168159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5f2c2-0cb1-4be6-8556-1e8f0b1747aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:26.170303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5f2c2-0cb1-4be6-8556-1e8f0b1747aa admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:26.181513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 851/1708] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:26.185815 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bf413-9e0d-4824-8c26-994b20bdda48 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:26.196091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bf413-9e0d-4824-8c26-994b20bdda48 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:26.201007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1ac0c-8088-49bc-bbbc-28b3c29377d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:26.201674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1ac0c-8088-49bc-bbbc-28b3c29377d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:26.201956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1ac0c-8088-49bc-bbbc-28b3c29377d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:26.202232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1ac0c-8088-49bc-bbbc-28b3c29377d2 admin admin] PATH_INFO: `/v3/projects/da05322e16fe4a338bad4081dd88e161/users/20b501c9e0da4dd3b550b7989c13e769/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:26.217772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1ac0c-8088-49bc-bbbc-28b3c29377d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da05322e16fe4a338bad4081dd88e161, user_id=20b501c9e0da4dd3b550b7989c13e769, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:26.220431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1ac0c-8088-49bc-bbbc-28b3c29377d2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:26.236255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 858/1709] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:26 2022] PUT /identity/v3/projects/da05322e16fe4a338bad4081dd88e161/users/20b501c9e0da4dd3b550b7989c13e769/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:26.241203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f2c2-0cb1-4be6-8556-1e8f0b1747aa admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:26.251201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f2c2-0cb1-4be6-8556-1e8f0b1747aa admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:26.309505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56f821-5d2a-4bb2-b037-d748af57b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:26.310119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56f821-5d2a-4bb2-b037-d748af57b851 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:26.310402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56f821-5d2a-4bb2-b037-d748af57b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:26.310676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56f821-5d2a-4bb2-b037-d748af57b851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:26.311329 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56f821-5d2a-4bb2-b037-d748af57b851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:26.312946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56f821-5d2a-4bb2-b037-d748af57b851 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:26.323771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 852/1710] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:35:26.327874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1ac0c-8088-49bc-bbbc-28b3c29377d2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:26.338584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1ac0c-8088-49bc-bbbc-28b3c29377d2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:26.343201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051491a-40ac-46d6-a1d1-4ac2f7b1f708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:26.343853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051491a-40ac-46d6-a1d1-4ac2f7b1f708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:26.344130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051491a-40ac-46d6-a1d1-4ac2f7b1f708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:26.344401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051491a-40ac-46d6-a1d1-4ac2f7b1f708 admin admin] PATH_INFO: `/v3/projects/da05322e16fe4a338bad4081dd88e161/users/20b501c9e0da4dd3b550b7989c13e769/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:26.346309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051491a-40ac-46d6-a1d1-4ac2f7b1f708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da05322e16fe4a338bad4081dd88e161, user_id=20b501c9e0da4dd3b550b7989c13e769, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:26.348985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051491a-40ac-46d6-a1d1-4ac2f7b1f708 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:26.360138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 859/1711] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:26 2022] PUT /identity/v3/projects/da05322e16fe4a338bad4081dd88e161/users/20b501c9e0da4dd3b550b7989c13e769/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:26.371524 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23573a3f-ebe2-4b89-a26f-f92f3f48c2a8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:26.371820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23573a3f-ebe2-4b89-a26f-f92f3f48c2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:26.372108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23573a3f-ebe2-4b89-a26f-f92f3f48c2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:26.401813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-23573a3f-ebe2-4b89-a26f-f92f3f48c2a8 None None] MFA Rules not processed for user `20b501c9e0da4dd3b550b7989c13e769`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:26.402942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-23573a3f-ebe2-4b89-a26f-f92f3f48c2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:26.473297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 853/1712] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:26.485471 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051491a-40ac-46d6-a1d1-4ac2f7b1f708 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:26.487497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9051491a-40ac-46d6-a1d1-4ac2f7b1f708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:26.509718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:26.544881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051491a-40ac-46d6-a1d1-4ac2f7b1f708 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:26.548500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a131b0-924a-4f4a-a9a8-bac9aaed503a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:26.549129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a131b0-924a-4f4a-a9a8-bac9aaed503a service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:26.549406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a131b0-924a-4f4a-a9a8-bac9aaed503a service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:26.549677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a131b0-924a-4f4a-a9a8-bac9aaed503a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:26.559139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a131b0-924a-4f4a-a9a8-bac9aaed503a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:26.560575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a131b0-924a-4f4a-a9a8-bac9aaed503a service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:26.570142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 860/1713] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:26.903281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23573a3f-ebe2-4b89-a26f-f92f3f48c2a8 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:26.914287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23573a3f-ebe2-4b89-a26f-f92f3f48c2a8 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:26.919753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca430e6-687b-47fb-86ed-988b415a817a tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b501c9e0da4dd3b550b7989c13e769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da05322e16fe4a338bad4081dd88e161', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:26.920443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca430e6-687b-47fb-86ed-988b415a817a tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:26.920820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca430e6-687b-47fb-86ed-988b415a817a tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:26.921227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca430e6-687b-47fb-86ed-988b415a817a tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:26.921875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca430e6-687b-47fb-86ed-988b415a817a tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:26.922221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca430e6-687b-47fb-86ed-988b415a817a tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:26.923973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca430e6-687b-47fb-86ed-988b415a817a tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:26.937545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 854/1714] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:35:26.941735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a131b0-924a-4f4a-a9a8-bac9aaed503a service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:26.950973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a131b0-924a-4f4a-a9a8-bac9aaed503a service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:26.957506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a829517-3a48-4f48-9661-957911653de5 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b501c9e0da4dd3b550b7989c13e769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da05322e16fe4a338bad4081dd88e161', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:26.957506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a829517-3a48-4f48-9661-957911653de5 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:26.957506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a829517-3a48-4f48-9661-957911653de5 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:26.957902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a829517-3a48-4f48-9661-957911653de5 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:26.958022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a829517-3a48-4f48-9661-957911653de5 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:26.959921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a829517-3a48-4f48-9661-957911653de5 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:26.994062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 861/1715] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:26 2022] POST /identity/v3/projects => generated 353 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:26.998134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca430e6-687b-47fb-86ed-988b415a817a tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:27.008390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca430e6-687b-47fb-86ed-988b415a817a tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:27.024302 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:27.084951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9964-c2d1-41c3-9d09-caae5790b6f1 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b501c9e0da4dd3b550b7989c13e769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da05322e16fe4a338bad4081dd88e161', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:27.085575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9964-c2d1-41c3-9d09-caae5790b6f1 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:27.085864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9964-c2d1-41c3-9d09-caae5790b6f1 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:27.086144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9964-c2d1-41c3-9d09-caae5790b6f1 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:27.086801 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9964-c2d1-41c3-9d09-caae5790b6f1 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:27.087108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9964-c2d1-41c3-9d09-caae5790b6f1 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:27.088768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9964-c2d1-41c3-9d09-caae5790b6f1 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:27.101870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 855/1716] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:35:27.143117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a829517-3a48-4f48-9661-957911653de5 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:27.153823 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a829517-3a48-4f48-9661-957911653de5 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:27.158295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b501c9e0da4dd3b550b7989c13e769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da05322e16fe4a338bad4081dd88e161', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:27.158911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:27.159196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:27.159505 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] PATH_INFO: `/v3/projects/4a14abef2de644389e2a1a6d2e6c9fdf` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:27.160644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a14abef2de644389e2a1a6d2e6c9fdf)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:27.162519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:27.214130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a14abef2de644389e2a1a6d2e6c9fdf', 'request_id': 'req-8371d8cb-a55c-432c-ac8e-a004c2564b9e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:27.219815 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a14abef2de644389e2a1a6d2e6c9fdf', 'request_id': 'req-8371d8cb-a55c-432c-ac8e-a004c2564b9e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:27.226623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a14abef2de644389e2a1a6d2e6c9fdf', 'request_id': 'req-8371d8cb-a55c-432c-ac8e-a004c2564b9e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:27.239753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] The token cache is being invalidate because project 4a14abef2de644389e2a1a6d2e6c9fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:27.240037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:27.240747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8371d8cb-a55c-432c-ac8e-a004c2564b9e tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:27.242278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 862/1717] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:27 2022] DELETE /identity/v3/projects/4a14abef2de644389e2a1a6d2e6c9fdf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:27.432490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9964-c2d1-41c3-9d09-caae5790b6f1 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:27.434402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-49eb9964-c2d1-41c3-9d09-caae5790b6f1 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:27.501451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9964-c2d1-41c3-9d09-caae5790b6f1 tempest-VolumeQuotaClassesTest-1683124673 tempest-VolumeQuotaClassesTest-1683124673-project-admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:27.557445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:27.558065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:27.558342 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:27.558611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] PATH_INFO: `/v3/users/53db02f820f74dcc97a21642eda8dc8e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:27.559695 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53db02f820f74dcc97a21642eda8dc8e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:27.561621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:27.607322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53db02f820f74dcc97a21642eda8dc8e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:27.607961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53db02f820f74dcc97a21642eda8dc8e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:27.615123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53db02f820f74dcc97a21642eda8dc8e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:27.615767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53db02f820f74dcc97a21642eda8dc8e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:27.617710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:27.630174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53db02f820f74dcc97a21642eda8dc8e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:27.642671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 856/1718] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:27 2022] DELETE /identity/v3/users/53db02f820f74dcc97a21642eda8dc8e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:27.647638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7941f4-da08-41c5-9e6e-dde494f7d63b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:27.648124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7941f4-da08-41c5-9e6e-dde494f7d63b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:27.648218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7941f4-da08-41c5-9e6e-dde494f7d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:27.668281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ed7941f4-da08-41c5-9e6e-dde494f7d63b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:27.669591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ed7941f4-da08-41c5-9e6e-dde494f7d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:27.733850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 863/1719] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:27.744485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:27.745949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:27.807159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cce34-2f79-41b7-9e93-f754a232e09b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:27.810986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c8b5a-4dbb-472d-b040-f26b366fe448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:27.811626 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c8b5a-4dbb-472d-b040-f26b366fe448 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:27.811962 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c8b5a-4dbb-472d-b040-f26b366fe448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:27.812242 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c8b5a-4dbb-472d-b040-f26b366fe448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:27.823125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c8b5a-4dbb-472d-b040-f26b366fe448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:27.824544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c8b5a-4dbb-472d-b040-f26b366fe448 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:27.835389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 857/1720] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:28.197737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7941f4-da08-41c5-9e6e-dde494f7d63b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:28.199546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ed7941f4-da08-41c5-9e6e-dde494f7d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:28.213377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7941f4-da08-41c5-9e6e-dde494f7d63b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:28.221388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:28.222646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:28.223162 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:28.223286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] PATH_INFO: `/v3/projects/7b2c61e4413248ffbf33b77955953a45` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:28.225116 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2c61e4413248ffbf33b77955953a45)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:28.227975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:28.260202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:28.297526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2c61e4413248ffbf33b77955953a45', 'request_id': 'req-f561e07e-c5af-4e06-bd72-6625a5ce667f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.309698 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2c61e4413248ffbf33b77955953a45', 'request_id': 'req-f561e07e-c5af-4e06-bd72-6625a5ce667f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.317282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2c61e4413248ffbf33b77955953a45', 'request_id': 'req-f561e07e-c5af-4e06-bd72-6625a5ce667f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.331806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] The token cache is being invalidate because project 7b2c61e4413248ffbf33b77955953a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:28.332110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.332799 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.334341 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 864/1721] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:28 2022] DELETE /identity/v3/projects/7b2c61e4413248ffbf33b77955953a45 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:28.338466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c8b5a-4dbb-472d-b040-f26b366fe448 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:28.349452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c8b5a-4dbb-472d-b040-f26b366fe448 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:28.418748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:28.419398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:28.419676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:28.419949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] PATH_INFO: `/v3/users/20b501c9e0da4dd3b550b7989c13e769` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:28.421133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b501c9e0da4dd3b550b7989c13e769)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:28.423059 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:28.474521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b501c9e0da4dd3b550b7989c13e769'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.475189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b501c9e0da4dd3b550b7989c13e769'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.484233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b501c9e0da4dd3b550b7989c13e769'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.485242 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b501c9e0da4dd3b550b7989c13e769'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.503026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fe6adcb3-fefb-466a-9acf-4ea73142873e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b501c9e0da4dd3b550b7989c13e769'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.512517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:28.522140 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 858/1722] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:28 2022] DELETE /identity/v3/users/20b501c9e0da4dd3b550b7989c13e769 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:28.813506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:28.814988 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:28.829215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561e07e-c5af-4e06-bd72-6625a5ce667f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:28.886666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:28.887295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:28.887572 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:28.887846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] PATH_INFO: `/v3/projects/da05322e16fe4a338bad4081dd88e161` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:28.888973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da05322e16fe4a338bad4081dd88e161)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:28.890856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:28.936224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da05322e16fe4a338bad4081dd88e161', 'request_id': 'req-22acf876-2397-45ec-8288-83e8ceb4837a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.942306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da05322e16fe4a338bad4081dd88e161', 'request_id': 'req-22acf876-2397-45ec-8288-83e8ceb4837a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.948599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da05322e16fe4a338bad4081dd88e161', 'request_id': 'req-22acf876-2397-45ec-8288-83e8ceb4837a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.960965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] The token cache is being invalidate because project da05322e16fe4a338bad4081dd88e161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:28.961250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.961897 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-22acf876-2397-45ec-8288-83e8ceb4837a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:28.963395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 865/1723] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:28 2022] DELETE /identity/v3/projects/da05322e16fe4a338bad4081dd88e161 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:28.968401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124e329-212c-448b-b9ff-d1267004c84f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:28.968767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124e329-212c-448b-b9ff-d1267004c84f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:28.969081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124e329-212c-448b-b9ff-d1267004c84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:28.989372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9124e329-212c-448b-b9ff-d1267004c84f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:28.990478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9124e329-212c-448b-b9ff-d1267004c84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:29.047991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 859/1724] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:29.056540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068830bd-71dd-4cce-98fa-ba582bffee9e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.056834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068830bd-71dd-4cce-98fa-ba582bffee9e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.057110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068830bd-71dd-4cce-98fa-ba582bffee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.077172 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-068830bd-71dd-4cce-98fa-ba582bffee9e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:29.078397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-068830bd-71dd-4cce-98fa-ba582bffee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:29.086295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 866/1725] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:29.090516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124e329-212c-448b-b9ff-d1267004c84f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.100227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124e329-212c-448b-b9ff-d1267004c84f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.104808 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadbd53-0a1c-482a-9072-3492a3ef3e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.105407 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadbd53-0a1c-482a-9072-3492a3ef3e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.105689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadbd53-0a1c-482a-9072-3492a3ef3e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.105964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadbd53-0a1c-482a-9072-3492a3ef3e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.106610 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadbd53-0a1c-482a-9072-3492a3ef3e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:29.106912 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadbd53-0a1c-482a-9072-3492a3ef3e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:29.108535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadbd53-0a1c-482a-9072-3492a3ef3e96 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:29.120670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 860/1726] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:35:29.125001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068830bd-71dd-4cce-98fa-ba582bffee9e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.134652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068830bd-71dd-4cce-98fa-ba582bffee9e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.139395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce50e-c6ca-4154-b336-a41487733945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.139987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce50e-c6ca-4154-b336-a41487733945 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.140267 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce50e-c6ca-4154-b336-a41487733945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.140580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce50e-c6ca-4154-b336-a41487733945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.141207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ce50e-c6ca-4154-b336-a41487733945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:29.143109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ce50e-c6ca-4154-b336-a41487733945 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:29.169533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 867/1727] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:29 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:29.173755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadbd53-0a1c-482a-9072-3492a3ef3e96 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.184886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadbd53-0a1c-482a-9072-3492a3ef3e96 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.243070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ac28e-762a-44a0-8f97-56abe4b2fd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.243605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac28e-762a-44a0-8f97-56abe4b2fd1b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.243887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac28e-762a-44a0-8f97-56abe4b2fd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.244160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac28e-762a-44a0-8f97-56abe4b2fd1b admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.244816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ac28e-762a-44a0-8f97-56abe4b2fd1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:29.246727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ac28e-762a-44a0-8f97-56abe4b2fd1b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:29.270193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 861/1728] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:29 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:29.274432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce50e-c6ca-4154-b336-a41487733945 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.285432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce50e-c6ca-4154-b336-a41487733945 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.290088 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eea85e-5909-4c20-bf5c-c15e3d845336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.290685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eea85e-5909-4c20-bf5c-c15e3d845336 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.290968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eea85e-5909-4c20-bf5c-c15e3d845336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.291242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eea85e-5909-4c20-bf5c-c15e3d845336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.291882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eea85e-5909-4c20-bf5c-c15e3d845336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:29.293500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eea85e-5909-4c20-bf5c-c15e3d845336 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:29.295603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:29.305689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 868/1729] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:29.309537 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ac28e-762a-44a0-8f97-56abe4b2fd1b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.320697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ac28e-762a-44a0-8f97-56abe4b2fd1b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.325477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44bd6b-a8c6-4b03-abc2-baf7085b8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.326081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bd6b-a8c6-4b03-abc2-baf7085b8d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.326512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bd6b-a8c6-4b03-abc2-baf7085b8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.326649 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bd6b-a8c6-4b03-abc2-baf7085b8d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.327249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44bd6b-a8c6-4b03-abc2-baf7085b8d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:29.328880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44bd6b-a8c6-4b03-abc2-baf7085b8d48 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:29.345688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 862/1730] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:29.350166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eea85e-5909-4c20-bf5c-c15e3d845336 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.363502 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eea85e-5909-4c20-bf5c-c15e3d845336 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.368268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954016c-0d6e-4f02-b65f-8903c46988fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.368971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954016c-0d6e-4f02-b65f-8903c46988fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.369274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954016c-0d6e-4f02-b65f-8903c46988fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.369545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954016c-0d6e-4f02-b65f-8903c46988fd admin admin] PATH_INFO: `/v3/projects/1fb946b2e7424f529d0ab6fffe8c38ed/users/4e9f0f86f6e94323864f56a868e1819d/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.384271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954016c-0d6e-4f02-b65f-8903c46988fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb946b2e7424f529d0ab6fffe8c38ed, user_id=4e9f0f86f6e94323864f56a868e1819d, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:29.386948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954016c-0d6e-4f02-b65f-8903c46988fd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:29.400659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 869/1731] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:29 2022] PUT /identity/v3/projects/1fb946b2e7424f529d0ab6fffe8c38ed/users/4e9f0f86f6e94323864f56a868e1819d/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:29.411673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53002ca3-7fbd-4db5-b0a6-7a9d7754e03e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.412069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53002ca3-7fbd-4db5-b0a6-7a9d7754e03e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.412404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53002ca3-7fbd-4db5-b0a6-7a9d7754e03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.442825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-53002ca3-7fbd-4db5-b0a6-7a9d7754e03e None None] MFA Rules not processed for user `4e9f0f86f6e94323864f56a868e1819d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:29.444786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-53002ca3-7fbd-4db5-b0a6-7a9d7754e03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:29.515433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:29.528318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 863/1732] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:29.532909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954016c-0d6e-4f02-b65f-8903c46988fd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.610097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954016c-0d6e-4f02-b65f-8903c46988fd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.617900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425c0db-3013-445f-b83a-4590d37b0385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.618627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425c0db-3013-445f-b83a-4590d37b0385 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.619123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425c0db-3013-445f-b83a-4590d37b0385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.619462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425c0db-3013-445f-b83a-4590d37b0385 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.620211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425c0db-3013-445f-b83a-4590d37b0385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:29.623002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425c0db-3013-445f-b83a-4590d37b0385 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:29.666913 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 870/1733] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:29 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:35:29.668048 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53002ca3-7fbd-4db5-b0a6-7a9d7754e03e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.681157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53002ca3-7fbd-4db5-b0a6-7a9d7754e03e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.767028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d44841-87b9-46bf-b4f4-874622f37037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.767561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d44841-87b9-46bf-b4f4-874622f37037 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.767966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d44841-87b9-46bf-b4f4-874622f37037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.768262 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d44841-87b9-46bf-b4f4-874622f37037 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.769487 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d44841-87b9-46bf-b4f4-874622f37037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:29.771778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d44841-87b9-46bf-b4f4-874622f37037 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:29.801028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 864/1734] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:29 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:29.805223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425c0db-3013-445f-b83a-4590d37b0385 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.817078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425c0db-3013-445f-b83a-4590d37b0385 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.823407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1e97-c7b9-4f1f-a385-817ece1003b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.824032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1e97-c7b9-4f1f-a385-817ece1003b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.824314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1e97-c7b9-4f1f-a385-817ece1003b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.824627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1e97-c7b9-4f1f-a385-817ece1003b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.825278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad1e97-c7b9-4f1f-a385-817ece1003b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:29.826928 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad1e97-c7b9-4f1f-a385-817ece1003b9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:29.839170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 871/1735] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:29.849821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d44841-87b9-46bf-b4f4-874622f37037 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.860670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d44841-87b9-46bf-b4f4-874622f37037 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.865867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a123bc-7983-4925-9b83-b48983418fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.866562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a123bc-7983-4925-9b83-b48983418fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.866842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a123bc-7983-4925-9b83-b48983418fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.867115 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a123bc-7983-4925-9b83-b48983418fd5 admin admin] PATH_INFO: `/v3/projects/1cf5ac71a1544e0ca44103b865de61de/users/22e9e588265a4e42a0304c4b313e69db/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.884088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a123bc-7983-4925-9b83-b48983418fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf5ac71a1544e0ca44103b865de61de, user_id=22e9e588265a4e42a0304c4b313e69db, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:29.887936 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a123bc-7983-4925-9b83-b48983418fd5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:29.904055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 865/1736] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:29 2022] PUT /identity/v3/projects/1cf5ac71a1544e0ca44103b865de61de/users/22e9e588265a4e42a0304c4b313e69db/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:29.908078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1e97-c7b9-4f1f-a385-817ece1003b9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:29.922567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1e97-c7b9-4f1f-a385-817ece1003b9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:29.996864 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2555b2a-a129-485d-907b-f7e0d097f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:29.997489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2555b2a-a129-485d-907b-f7e0d097f423 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:29.997775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2555b2a-a129-485d-907b-f7e0d097f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:29.998055 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2555b2a-a129-485d-907b-f7e0d097f423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:29.998704 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2555b2a-a129-485d-907b-f7e0d097f423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:30.000290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2555b2a-a129-485d-907b-f7e0d097f423 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:30.010959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 872/1737] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:30.015218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a123bc-7983-4925-9b83-b48983418fd5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:30.026231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a123bc-7983-4925-9b83-b48983418fd5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:30.031154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe63cc-443c-465f-97c9-f09147f20186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:30.031808 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe63cc-443c-465f-97c9-f09147f20186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:30.032087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe63cc-443c-465f-97c9-f09147f20186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:30.032357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe63cc-443c-465f-97c9-f09147f20186 admin admin] PATH_INFO: `/v3/projects/1cf5ac71a1544e0ca44103b865de61de/users/22e9e588265a4e42a0304c4b313e69db/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:30.034287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe63cc-443c-465f-97c9-f09147f20186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf5ac71a1544e0ca44103b865de61de, user_id=22e9e588265a4e42a0304c4b313e69db, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:30.037590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe63cc-443c-465f-97c9-f09147f20186 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:30.049737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 866/1738] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:30 2022] PUT /identity/v3/projects/1cf5ac71a1544e0ca44103b865de61de/users/22e9e588265a4e42a0304c4b313e69db/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:30.060486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbcf22-3e85-431a-a11e-ee785e1f39f9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:30.060796 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbcf22-3e85-431a-a11e-ee785e1f39f9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:30.061080 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbcf22-3e85-431a-a11e-ee785e1f39f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:30.093825 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1dbbcf22-3e85-431a-a11e-ee785e1f39f9 None None] MFA Rules not processed for user `22e9e588265a4e42a0304c4b313e69db`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:30.095790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1dbbcf22-3e85-431a-a11e-ee785e1f39f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:30.133483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:30.176020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 873/1739] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:30.187058 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe63cc-443c-465f-97c9-f09147f20186 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:30.188957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9ffe63cc-443c-465f-97c9-f09147f20186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:30.256366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe63cc-443c-465f-97c9-f09147f20186 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:30.260163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd45324-b631-48c4-afd5-a7bb6ae8b4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:30.260809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd45324-b631-48c4-afd5-a7bb6ae8b4ed service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:30.261091 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd45324-b631-48c4-afd5-a7bb6ae8b4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:30.261362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd45324-b631-48c4-afd5-a7bb6ae8b4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:30.329682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd45324-b631-48c4-afd5-a7bb6ae8b4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:30.331248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd45324-b631-48c4-afd5-a7bb6ae8b4ed service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:30.337418 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:30.342798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 867/1740] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:32.927540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbcf22-3e85-431a-a11e-ee785e1f39f9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:32.988600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbcf22-3e85-431a-a11e-ee785e1f39f9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:32.993270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:32.993955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:32.994237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:32.994509 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] PATH_INFO: `/v3/users/4e9f0f86f6e94323864f56a868e1819d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:32.995615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9f0f86f6e94323864f56a868e1819d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:32.997550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:33.042878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9f0f86f6e94323864f56a868e1819d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.043528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9f0f86f6e94323864f56a868e1819d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.050540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9f0f86f6e94323864f56a868e1819d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.057350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9f0f86f6e94323864f56a868e1819d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.057960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9f0f86f6e94323864f56a868e1819d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.075643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 874/1741] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:32 2022] DELETE /identity/v3/users/4e9f0f86f6e94323864f56a868e1819d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:33.080225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e5458-7c4c-4f15-9549-149dbb0b21aa None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:33.080732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e5458-7c4c-4f15-9549-149dbb0b21aa None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:33.080849 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e5458-7c4c-4f15-9549-149dbb0b21aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:33.100041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fb6e5458-7c4c-4f15-9549-149dbb0b21aa None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:33.101336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fb6e5458-7c4c-4f15-9549-149dbb0b21aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:33.160311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 868/1742] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:33.170017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:33.171465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:33.224537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:33.228352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185740fb-9f1d-4668-b67e-eb39dc19fd11 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:33.233021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a6621-cfc7-481f-be95-585b56ea5f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:33.233737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a6621-cfc7-481f-be95-585b56ea5f04 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:33.234024 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a6621-cfc7-481f-be95-585b56ea5f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:33.234475 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a6621-cfc7-481f-be95-585b56ea5f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:33.244105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a6621-cfc7-481f-be95-585b56ea5f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:33.245552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a6621-cfc7-481f-be95-585b56ea5f04 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:33.255602 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 875/1743] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:33.531375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e5458-7c4c-4f15-9549-149dbb0b21aa None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:33.532892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fb6e5458-7c4c-4f15-9549-149dbb0b21aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:33.557570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e5458-7c4c-4f15-9549-149dbb0b21aa None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:33.562769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:33.563562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:33.563940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:33.564346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] PATH_INFO: `/v3/projects/1fb946b2e7424f529d0ab6fffe8c38ed` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:33.566273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb946b2e7424f529d0ab6fffe8c38ed)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:33.568660 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:33.632173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb946b2e7424f529d0ab6fffe8c38ed', 'request_id': 'req-6413840a-fbbc-479c-8047-a1d1eceb69c9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.641805 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb946b2e7424f529d0ab6fffe8c38ed', 'request_id': 'req-6413840a-fbbc-479c-8047-a1d1eceb69c9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.648344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb946b2e7424f529d0ab6fffe8c38ed', 'request_id': 'req-6413840a-fbbc-479c-8047-a1d1eceb69c9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.661803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] The token cache is being invalidate because project 1fb946b2e7424f529d0ab6fffe8c38ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:33.662099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.662763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.664900 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 869/1744] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:33 2022] DELETE /identity/v3/projects/1fb946b2e7424f529d0ab6fffe8c38ed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:33.668181 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a6621-cfc7-481f-be95-585b56ea5f04 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:33.679105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a6621-cfc7-481f-be95-585b56ea5f04 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:33.749459 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:33.750204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:33.750556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:33.750900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] PATH_INFO: `/v3/users/22e9e588265a4e42a0304c4b313e69db` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:33.752116 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e9e588265a4e42a0304c4b313e69db)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:33.755303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:33.817741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e9e588265a4e42a0304c4b313e69db'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.818495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e9e588265a4e42a0304c4b313e69db'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.835465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e9e588265a4e42a0304c4b313e69db'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.846520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e9e588265a4e42a0304c4b313e69db'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.848490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7052ba59-39a0-4cec-ac87-0cf504cc12f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e9e588265a4e42a0304c4b313e69db'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:33.879909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 876/1745] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:33 2022] DELETE /identity/v3/users/22e9e588265a4e42a0304c4b313e69db => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:34.454907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:34.456945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:34.487493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413840a-fbbc-479c-8047-a1d1eceb69c9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:34.555852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:34.556520 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:34.556814 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:34.557077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] PATH_INFO: `/v3/projects/1cf5ac71a1544e0ca44103b865de61de` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:34.558208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf5ac71a1544e0ca44103b865de61de)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:34.561775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:34.602671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:34.626830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf5ac71a1544e0ca44103b865de61de', 'request_id': 'req-a51d6ab3-1142-4912-942c-9dfa0dbb3091'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:34.636757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf5ac71a1544e0ca44103b865de61de', 'request_id': 'req-a51d6ab3-1142-4912-942c-9dfa0dbb3091'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:34.645088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf5ac71a1544e0ca44103b865de61de', 'request_id': 'req-a51d6ab3-1142-4912-942c-9dfa0dbb3091'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:34.657233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] The token cache is being invalidate because project 1cf5ac71a1544e0ca44103b865de61de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:34.657577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:34.658353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a51d6ab3-1142-4912-942c-9dfa0dbb3091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:34.661296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 870/1746] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:34 2022] DELETE /identity/v3/projects/1cf5ac71a1544e0ca44103b865de61de => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:34.666354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a9ae-2cc6-468f-9594-f8432b09c06b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:34.666874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a9ae-2cc6-468f-9594-f8432b09c06b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:34.666874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a9ae-2cc6-468f-9594-f8432b09c06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:34.694140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ca31a9ae-2cc6-468f-9594-f8432b09c06b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:34.695363 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ca31a9ae-2cc6-468f-9594-f8432b09c06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:34.763506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 877/1747] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:34.771400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bc00e-176b-4c8a-aeb8-2a9ff8a57d6b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:34.771770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bc00e-176b-4c8a-aeb8-2a9ff8a57d6b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:34.772111 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bc00e-176b-4c8a-aeb8-2a9ff8a57d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:34.795697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8e6bc00e-176b-4c8a-aeb8-2a9ff8a57d6b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:34.797486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8e6bc00e-176b-4c8a-aeb8-2a9ff8a57d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:34.807304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 871/1748] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:34.811687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31a9ae-2cc6-468f-9594-f8432b09c06b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:34.822139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31a9ae-2cc6-468f-9594-f8432b09c06b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:34.834784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee950200-ba4b-422f-b53a-212d86c19213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:34.835484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee950200-ba4b-422f-b53a-212d86c19213 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:34.835836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee950200-ba4b-422f-b53a-212d86c19213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:34.836595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee950200-ba4b-422f-b53a-212d86c19213 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:34.836955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee950200-ba4b-422f-b53a-212d86c19213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:34.837327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee950200-ba4b-422f-b53a-212d86c19213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:34.838989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee950200-ba4b-422f-b53a-212d86c19213 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:34.847227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:34.856547 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 878/1749] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:35:34.857531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bc00e-176b-4c8a-aeb8-2a9ff8a57d6b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:34.867621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bc00e-176b-4c8a-aeb8-2a9ff8a57d6b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:34.872351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838fc28-f859-464d-91e1-bf1746b60d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:34.872981 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838fc28-f859-464d-91e1-bf1746b60d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:34.873261 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838fc28-f859-464d-91e1-bf1746b60d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:34.873532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838fc28-f859-464d-91e1-bf1746b60d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:34.874195 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838fc28-f859-464d-91e1-bf1746b60d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:34.876069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838fc28-f859-464d-91e1-bf1746b60d99 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:34.903963 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 872/1750] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:34 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:34.908033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee950200-ba4b-422f-b53a-212d86c19213 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:34.918567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee950200-ba4b-422f-b53a-212d86c19213 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:34.980929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbeef5b-973b-467d-9c0f-514b0db619e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:34.981640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeef5b-973b-467d-9c0f-514b0db619e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:34.981932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeef5b-973b-467d-9c0f-514b0db619e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:34.982199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeef5b-973b-467d-9c0f-514b0db619e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:34.982840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbeef5b-973b-467d-9c0f-514b0db619e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:34.984759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbeef5b-973b-467d-9c0f-514b0db619e3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.008010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 879/1751] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:34 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:35.011889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838fc28-f859-464d-91e1-bf1746b60d99 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.020421 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33f7df-8c73-4b34-9a84-2e6425cd716f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.020839 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33f7df-8c73-4b34-9a84-2e6425cd716f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.021200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33f7df-8c73-4b34-9a84-2e6425cd716f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.022759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 880/1752] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:35:35.024493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838fc28-f859-464d-91e1-bf1746b60d99 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.029309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29446461-710f-4b45-828c-5cae58d4a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.029952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446461-710f-4b45-828c-5cae58d4a6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.030233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446461-710f-4b45-828c-5cae58d4a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.030505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446461-710f-4b45-828c-5cae58d4a6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.031213 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29446461-710f-4b45-828c-5cae58d4a6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.032886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29446461-710f-4b45-828c-5cae58d4a6ba admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.047316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 873/1753] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:35:35.047726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8cdea-5185-4eec-beef-6693571f97ce None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.048104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8cdea-5185-4eec-beef-6693571f97ce None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.048512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8cdea-5185-4eec-beef-6693571f97ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.051702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29446461-710f-4b45-828c-5cae58d4a6ba admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.065171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29446461-710f-4b45-828c-5cae58d4a6ba admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.070606 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-90b8cdea-5185-4eec-beef-6693571f97ce None None] MFA Rules not processed for user `91b2777a51af45f5a86627d840f5b814`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:35.071827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-90b8cdea-5185-4eec-beef-6693571f97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:35.073193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c50158-6e5a-49b0-9aa3-d3f541205578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.074368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c50158-6e5a-49b0-9aa3-d3f541205578 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.074831 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c50158-6e5a-49b0-9aa3-d3f541205578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.075284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c50158-6e5a-49b0-9aa3-d3f541205578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.076130 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c50158-6e5a-49b0-9aa3-d3f541205578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.078369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c50158-6e5a-49b0-9aa3-d3f541205578 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.096588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 874/1754] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:35:35.101251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c50158-6e5a-49b0-9aa3-d3f541205578 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.126770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c50158-6e5a-49b0-9aa3-d3f541205578 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.132692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a10e5d-736e-4e0f-93ff-a1fe3a5b03c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.132947 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a10e5d-736e-4e0f-93ff-a1fe3a5b03c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.133221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a10e5d-736e-4e0f-93ff-a1fe3a5b03c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.133573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a10e5d-736e-4e0f-93ff-a1fe3a5b03c2 admin admin] PATH_INFO: `/v3/projects/d47879d646a34df991d7b043a521e4fb/users/c0d62866dcb042e58c6ac5f34d2c32ec/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.153393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a10e5d-736e-4e0f-93ff-a1fe3a5b03c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47879d646a34df991d7b043a521e4fb, user_id=c0d62866dcb042e58c6ac5f34d2c32ec, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.156132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a10e5d-736e-4e0f-93ff-a1fe3a5b03c2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.164728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 881/1755] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:35:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:35.165806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8cdea-5185-4eec-beef-6693571f97ce None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.168129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-90b8cdea-5185-4eec-beef-6693571f97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:35.171163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 875/1756] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:35 2022] PUT /identity/v3/projects/d47879d646a34df991d7b043a521e4fb/users/c0d62866dcb042e58c6ac5f34d2c32ec/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:35.177363 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a10e5d-736e-4e0f-93ff-a1fe3a5b03c2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.180836 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c7a10e5d-736e-4e0f-93ff-a1fe3a5b03c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:35.183252 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8cdea-5185-4eec-beef-6693571f97ce None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.241844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.242491 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.242948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.243230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] PATH_INFO: `/v3/users/f9558205f6b449e6b322455e288852fd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.244406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9558205f6b449e6b322455e288852fd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.246391 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.260164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a10e5d-736e-4e0f-93ff-a1fe3a5b03c2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.266796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88198-7ee5-4a0e-bfac-ff4a84b9f47b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.267453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88198-7ee5-4a0e-bfac-ff4a84b9f47b service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.267709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88198-7ee5-4a0e-bfac-ff4a84b9f47b service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.268004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88198-7ee5-4a0e-bfac-ff4a84b9f47b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.278696 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be88198-7ee5-4a0e-bfac-ff4a84b9f47b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.280297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be88198-7ee5-4a0e-bfac-ff4a84b9f47b service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.285440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:35.292931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 876/1757] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:35:35.294232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4321422-08e9-4b9c-a908-48ace592b4ce None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.294519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4321422-08e9-4b9c-a908-48ace592b4ce None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.294794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4321422-08e9-4b9c-a908-48ace592b4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.308265 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9558205f6b449e6b322455e288852fd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.308934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9558205f6b449e6b322455e288852fd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.325330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9558205f6b449e6b322455e288852fd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.330840 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d4321422-08e9-4b9c-a908-48ace592b4ce None None] MFA Rules not processed for user `c0d62866dcb042e58c6ac5f34d2c32ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:35.333217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d4321422-08e9-4b9c-a908-48ace592b4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:35.337009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9558205f6b449e6b322455e288852fd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.337718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9558205f6b449e6b322455e288852fd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.352968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:35.360732 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 882/1758] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:35 2022] DELETE /identity/v3/users/f9558205f6b449e6b322455e288852fd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:35.409761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 877/1759] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:35.417141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.418636 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:35.485096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f390c-b488-4d35-868f-13c685b8d660 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.491336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aadf2-aa01-4579-adf9-21d895dbd88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.491960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aadf2-aa01-4579-adf9-21d895dbd88c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.492242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aadf2-aa01-4579-adf9-21d895dbd88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.492540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aadf2-aa01-4579-adf9-21d895dbd88c admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.493178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aadf2-aa01-4579-adf9-21d895dbd88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.495068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aadf2-aa01-4579-adf9-21d895dbd88c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.524497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 883/1760] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:35 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:35.526746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4321422-08e9-4b9c-a908-48ace592b4ce None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.538326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4321422-08e9-4b9c-a908-48ace592b4ce None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.545034 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aadf2-aa01-4579-adf9-21d895dbd88c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.547049 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d60aadf2-aa01-4579-adf9-21d895dbd88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:35.608439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6a1a-9601-43f7-a124-1a6141089ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.609364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6a1a-9601-43f7-a124-1a6141089ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.609364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6a1a-9601-43f7-a124-1a6141089ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.609603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6a1a-9601-43f7-a124-1a6141089ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.610332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc6a1a-9601-43f7-a124-1a6141089ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.613192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc6a1a-9601-43f7-a124-1a6141089ca7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.634766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 878/1761] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:35 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:35.635131 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aadf2-aa01-4579-adf9-21d895dbd88c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.638556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6a1a-9601-43f7-a124-1a6141089ca7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.640350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.641023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.641306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.641586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] PATH_INFO: `/v3/projects/a36c1840d9c0479496397270560dfa12` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.642717 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36c1840d9c0479496397270560dfa12)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.645295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.648752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6a1a-9601-43f7-a124-1a6141089ca7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.654349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fd3fd-6933-498f-9771-b1746c7537ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.655035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd3fd-6933-498f-9771-b1746c7537ba admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.655348 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd3fd-6933-498f-9771-b1746c7537ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.655713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd3fd-6933-498f-9771-b1746c7537ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.656346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fd3fd-6933-498f-9771-b1746c7537ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.658057 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fd3fd-6933-498f-9771-b1746c7537ba admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.671916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 879/1762] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:35:35.672952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fd3fd-6933-498f-9771-b1746c7537ba admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.682916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:35.684045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fd3fd-6933-498f-9771-b1746c7537ba admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.697601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36c1840d9c0479496397270560dfa12', 'request_id': 'req-25142085-460c-4db3-ab61-ab6d7c1e9bc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.703067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36c1840d9c0479496397270560dfa12', 'request_id': 'req-25142085-460c-4db3-ab61-ab6d7c1e9bc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.709959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36c1840d9c0479496397270560dfa12', 'request_id': 'req-25142085-460c-4db3-ab61-ab6d7c1e9bc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.723942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] The token cache is being invalidate because project a36c1840d9c0479496397270560dfa12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:35.724213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.724916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.726413 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 884/1763] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:35 2022] DELETE /identity/v3/projects/a36c1840d9c0479496397270560dfa12 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:35.730312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.731705 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:35.746413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fa8f9-a9ae-49f3-800b-37ab90d0974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.747025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa8f9-a9ae-49f3-800b-37ab90d0974c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.747303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa8f9-a9ae-49f3-800b-37ab90d0974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.747575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa8f9-a9ae-49f3-800b-37ab90d0974c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.748210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fa8f9-a9ae-49f3-800b-37ab90d0974c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.749839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fa8f9-a9ae-49f3-800b-37ab90d0974c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.759582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 880/1764] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:35.763579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fa8f9-a9ae-49f3-800b-37ab90d0974c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.765274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d38fa8f9-a9ae-49f3-800b-37ab90d0974c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:35.777828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fa8f9-a9ae-49f3-800b-37ab90d0974c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.783439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a5375-7838-43bf-a57d-88ad067aa1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.784090 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a5375-7838-43bf-a57d-88ad067aa1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.785239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a5375-7838-43bf-a57d-88ad067aa1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.785536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a5375-7838-43bf-a57d-88ad067aa1e5 admin admin] PATH_INFO: `/v3/projects/c270d96a4c1c4d009fcc707d88027040/users/ac1883883fec45fd97ef2865da959e7a/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.798448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142085-460c-4db3-ab61-ab6d7c1e9bc3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:35.801227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a5375-7838-43bf-a57d-88ad067aa1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c270d96a4c1c4d009fcc707d88027040, user_id=ac1883883fec45fd97ef2865da959e7a, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.803425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:35.803873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a5375-7838-43bf-a57d-88ad067aa1e5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.804060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.804343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.804656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] PATH_INFO: `/v3/users/2f60bdeeeb30404c9c8f457a9085e606` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.805799 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f60bdeeeb30404c9c8f457a9085e606)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:35.807712 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:35.817370 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 881/1765] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:35 2022] PUT /identity/v3/projects/c270d96a4c1c4d009fcc707d88027040/users/ac1883883fec45fd97ef2865da959e7a/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:35.827474 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ede4d-5cf2-4057-ab95-929d68ab756e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:35.827757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ede4d-5cf2-4057-ab95-929d68ab756e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:35.828032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ede4d-5cf2-4057-ab95-929d68ab756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:35.852507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:35.861248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f60bdeeeb30404c9c8f457a9085e606'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.862305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f60bdeeeb30404c9c8f457a9085e606'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.864008 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c89ede4d-5cf2-4057-ab95-929d68ab756e None None] MFA Rules not processed for user `ac1883883fec45fd97ef2865da959e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:35.866752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c89ede4d-5cf2-4057-ab95-929d68ab756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:35.869759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f60bdeeeb30404c9c8f457a9085e606'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.878254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f60bdeeeb30404c9c8f457a9085e606'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.879010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f60bdeeeb30404c9c8f457a9085e606'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:35.899376 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 885/1766] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:35 2022] DELETE /identity/v3/users/2f60bdeeeb30404c9c8f457a9085e606 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:35.941233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 882/1767] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:35:35.946150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:35.948045 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:35.998160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:36.028192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1b1c5-a32d-45f7-ad0d-ea7fa90ffe8b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.036985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f183-4344-44ae-b07f-599f1dc6d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.037682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f183-4344-44ae-b07f-599f1dc6d7aa admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.038080 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f183-4344-44ae-b07f-599f1dc6d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.038367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f183-4344-44ae-b07f-599f1dc6d7aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.039031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227f183-4344-44ae-b07f-599f1dc6d7aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.041348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227f183-4344-44ae-b07f-599f1dc6d7aa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.078937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 886/1768] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:35 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:36.084272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ede4d-5cf2-4057-ab95-929d68ab756e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.089376 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f183-4344-44ae-b07f-599f1dc6d7aa admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.091290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4227f183-4344-44ae-b07f-599f1dc6d7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:36.161182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ede4d-5cf2-4057-ab95-929d68ab756e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.171239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd2d8e-efc1-4d18-a3fd-17cdb269ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.171873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd2d8e-efc1-4d18-a3fd-17cdb269ebc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.172154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd2d8e-efc1-4d18-a3fd-17cdb269ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.172424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd2d8e-efc1-4d18-a3fd-17cdb269ebc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.173096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd2d8e-efc1-4d18-a3fd-17cdb269ebc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.175235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd2d8e-efc1-4d18-a3fd-17cdb269ebc6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.176876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f183-4344-44ae-b07f-599f1dc6d7aa admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.183254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.184018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.184402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.184805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] PATH_INFO: `/v3/projects/0d8ade5fcd91413a90e84bcbd6c93fb1` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.185998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8ade5fcd91413a90e84bcbd6c93fb1)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.188097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.202629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 883/1769] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:36 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:35:36.204055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd2d8e-efc1-4d18-a3fd-17cdb269ebc6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.219898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd2d8e-efc1-4d18-a3fd-17cdb269ebc6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.226036 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af987a1-f90e-417d-9cd5-825e56268e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.226710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af987a1-f90e-417d-9cd5-825e56268e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.227237 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af987a1-f90e-417d-9cd5-825e56268e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.227518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af987a1-f90e-417d-9cd5-825e56268e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.228173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af987a1-f90e-417d-9cd5-825e56268e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.229925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af987a1-f90e-417d-9cd5-825e56268e0d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.241195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8ade5fcd91413a90e84bcbd6c93fb1', 'request_id': 'req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:36.241932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 884/1770] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:35:36.246192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af987a1-f90e-417d-9cd5-825e56268e0d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.247814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8ade5fcd91413a90e84bcbd6c93fb1', 'request_id': 'req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:36.255424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8ade5fcd91413a90e84bcbd6c93fb1', 'request_id': 'req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:36.257088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af987a1-f90e-417d-9cd5-825e56268e0d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.272184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] The token cache is being invalidate because project 0d8ade5fcd91413a90e84bcbd6c93fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:36.272573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:36.273317 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9a9eb68-05e6-42ed-ad16-f6b69edacf72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:36.278641 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 887/1771] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:36 2022] DELETE /identity/v3/projects/0d8ade5fcd91413a90e84bcbd6c93fb1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:36.282112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19371a79-71ad-4181-986a-8ed0370d27d5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.282288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19371a79-71ad-4181-986a-8ed0370d27d5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.282489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19371a79-71ad-4181-986a-8ed0370d27d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.309266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-19371a79-71ad-4181-986a-8ed0370d27d5 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:36.311090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19371a79-71ad-4181-986a-8ed0370d27d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:36.324139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2d24a-0668-487c-aaf0-948d452d2461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.325042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2d24a-0668-487c-aaf0-948d452d2461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.325386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2d24a-0668-487c-aaf0-948d452d2461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.325736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2d24a-0668-487c-aaf0-948d452d2461 admin admin] PATH_INFO: `/v3/projects/0f60efb90fe940afb887a7fa6d1a30a3/users/c0b854bc53a54c39b2c21fd5d46cd23a/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.343286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2d24a-0668-487c-aaf0-948d452d2461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f60efb90fe940afb887a7fa6d1a30a3, user_id=c0b854bc53a54c39b2c21fd5d46cd23a, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.346143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2d24a-0668-487c-aaf0-948d452d2461 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.355960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:36.361940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 885/1772] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:36 2022] PUT /identity/v3/projects/0f60efb90fe940afb887a7fa6d1a30a3/users/c0b854bc53a54c39b2c21fd5d46cd23a/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:36.366749 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2d24a-0668-487c-aaf0-948d452d2461 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.368859 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-79f2d24a-0668-487c-aaf0-948d452d2461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:36.370278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:36.384431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 888/1773] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:35:36.386330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3f00a-118a-4c47-8a63-995fe60c7f38 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.386620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3f00a-118a-4c47-8a63-995fe60c7f38 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.386915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3f00a-118a-4c47-8a63-995fe60c7f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.405836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fef3f00a-118a-4c47-8a63-995fe60c7f38 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:36.407122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fef3f00a-118a-4c47-8a63-995fe60c7f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:36.443976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2d24a-0668-487c-aaf0-948d452d2461 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.448748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e9bde-684b-41e0-b911-743b375fe211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.449365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e9bde-684b-41e0-b911-743b375fe211 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.449643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e9bde-684b-41e0-b911-743b375fe211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.449919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e9bde-684b-41e0-b911-743b375fe211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.450560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e9bde-684b-41e0-b911-743b375fe211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.452144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e9bde-684b-41e0-b911-743b375fe211 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.462930 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 886/1774] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:36.464257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51804a57-adbe-4045-93b3-e346d58f61d5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.464574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51804a57-adbe-4045-93b3-e346d58f61d5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.464845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51804a57-adbe-4045-93b3-e346d58f61d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.465533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 889/1775] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:36.467098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3f00a-118a-4c47-8a63-995fe60c7f38 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.485177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-51804a57-adbe-4045-93b3-e346d58f61d5 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:36.485590 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3f00a-118a-4c47-8a63-995fe60c7f38 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.486436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-51804a57-adbe-4045-93b3-e346d58f61d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:36.491495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762211-8d01-4991-b36c-f10026c97a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.492441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762211-8d01-4991-b36c-f10026c97a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.492789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762211-8d01-4991-b36c-f10026c97a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.493064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762211-8d01-4991-b36c-f10026c97a79 admin admin] PATH_INFO: `/v3/projects/0f60efb90fe940afb887a7fa6d1a30a3/users/c0b854bc53a54c39b2c21fd5d46cd23a/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.498831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b762211-8d01-4991-b36c-f10026c97a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f60efb90fe940afb887a7fa6d1a30a3, user_id=c0b854bc53a54c39b2c21fd5d46cd23a, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.499385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 887/1776] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:36.499575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b762211-8d01-4991-b36c-f10026c97a79 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.501430 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51804a57-adbe-4045-93b3-e346d58f61d5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.510258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 890/1777] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:36 2022] PUT /identity/v3/projects/0f60efb90fe940afb887a7fa6d1a30a3/users/c0b854bc53a54c39b2c21fd5d46cd23a/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:36.511660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762211-8d01-4991-b36c-f10026c97a79 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.513375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b762211-8d01-4991-b36c-f10026c97a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:36.514726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51804a57-adbe-4045-93b3-e346d58f61d5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.576656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468051b-e434-4a01-aba2-661b40a0a910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.577288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468051b-e434-4a01-aba2-661b40a0a910 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.577448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468051b-e434-4a01-aba2-661b40a0a910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.577719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468051b-e434-4a01-aba2-661b40a0a910 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.578362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468051b-e434-4a01-aba2-661b40a0a910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:36.578668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468051b-e434-4a01-aba2-661b40a0a910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.580282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468051b-e434-4a01-aba2-661b40a0a910 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.589589 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762211-8d01-4991-b36c-f10026c97a79 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.592055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 888/1778] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:35:36.593322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f7376-68d1-4e14-a225-3adac842fb22 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.593605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f7376-68d1-4e14-a225-3adac842fb22 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.593874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f7376-68d1-4e14-a225-3adac842fb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.599238 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eadbdc-8d42-447b-8eb2-0bd1dfab288b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.599854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eadbdc-8d42-447b-8eb2-0bd1dfab288b service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.600139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eadbdc-8d42-447b-8eb2-0bd1dfab288b service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.600414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eadbdc-8d42-447b-8eb2-0bd1dfab288b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.622467 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-fb9f7376-68d1-4e14-a225-3adac842fb22 None None] MFA Rules not processed for user `c0b854bc53a54c39b2c21fd5d46cd23a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:36.623656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fb9f7376-68d1-4e14-a225-3adac842fb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:36.657630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eadbdc-8d42-447b-8eb2-0bd1dfab288b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.659272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eadbdc-8d42-447b-8eb2-0bd1dfab288b service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.668016 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 891/1779] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:35:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 03:35:36.668920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eadbdc-8d42-447b-8eb2-0bd1dfab288b service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.679354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eadbdc-8d42-447b-8eb2-0bd1dfab288b service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.685698 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3abac-0786-4bf5-9c54-b4b2b65f6936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.686916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3abac-0786-4bf5-9c54-b4b2b65f6936 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.687206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3abac-0786-4bf5-9c54-b4b2b65f6936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.687527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3abac-0786-4bf5-9c54-b4b2b65f6936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.688110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3abac-0786-4bf5-9c54-b4b2b65f6936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.690191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3abac-0786-4bf5-9c54-b4b2b65f6936 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.696601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 889/1780] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:36.709537 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f7376-68d1-4e14-a225-3adac842fb22 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.711116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fb9f7376-68d1-4e14-a225-3adac842fb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:36.724895 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:36.725583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 892/1781] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:36 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:36.731118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3abac-0786-4bf5-9c54-b4b2b65f6936 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.737306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:36.789400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f7376-68d1-4e14-a225-3adac842fb22 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.802843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3abac-0786-4bf5-9c54-b4b2b65f6936 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.808308 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec55f3-32bd-4b16-93b2-e2b926db6c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.808918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec55f3-32bd-4b16-93b2-e2b926db6c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.809203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec55f3-32bd-4b16-93b2-e2b926db6c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.810426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec55f3-32bd-4b16-93b2-e2b926db6c0b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.814811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec55f3-32bd-4b16-93b2-e2b926db6c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.814811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec55f3-32bd-4b16-93b2-e2b926db6c0b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.846075 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eb207-9456-4172-be00-5efa4eed6e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.847256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eb207-9456-4172-be00-5efa4eed6e15 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.847537 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eb207-9456-4172-be00-5efa4eed6e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.847803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eb207-9456-4172-be00-5efa4eed6e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.852516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 893/1782] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:36 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:36.852655 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bf9eb207-9456-4172-be00-5efa4eed6e15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:36.853324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec55f3-32bd-4b16-93b2-e2b926db6c0b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.864888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec55f3-32bd-4b16-93b2-e2b926db6c0b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.869878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc0054-30b2-4782-956a-426289a39619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.871198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc0054-30b2-4782-956a-426289a39619 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.871492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc0054-30b2-4782-956a-426289a39619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.871825 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc0054-30b2-4782-956a-426289a39619 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.872650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc0054-30b2-4782-956a-426289a39619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.875001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc0054-30b2-4782-956a-426289a39619 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.888510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 894/1783] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:35:36.891791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc0054-30b2-4782-956a-426289a39619 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.904230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc0054-30b2-4782-956a-426289a39619 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.909933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a48a6-c222-4482-9dc0-ca85bdbeb0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.910614 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a48a6-c222-4482-9dc0-ca85bdbeb0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.910811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a48a6-c222-4482-9dc0-ca85bdbeb0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.911108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a48a6-c222-4482-9dc0-ca85bdbeb0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.911871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a48a6-c222-4482-9dc0-ca85bdbeb0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.913573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a48a6-c222-4482-9dc0-ca85bdbeb0e4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.916701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eb207-9456-4172-be00-5efa4eed6e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.918191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eb207-9456-4172-be00-5efa4eed6e15 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.923638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 895/1784] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:36.928431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a48a6-c222-4482-9dc0-ca85bdbeb0e4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:36.931641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 890/1785] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:36.944657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a48a6-c222-4482-9dc0-ca85bdbeb0e4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:36.949726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c24f05-46ae-4e72-a24d-10987a19a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:36.950463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c24f05-46ae-4e72-a24d-10987a19a347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.950817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c24f05-46ae-4e72-a24d-10987a19a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.951169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c24f05-46ae-4e72-a24d-10987a19a347 admin admin] PATH_INFO: `/v3/projects/acb6f60904cb484e99ae9b9eff59cb1e/users/1f80196008c14157b3ed3e53228f56ca/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:36.967896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c24f05-46ae-4e72-a24d-10987a19a347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb6f60904cb484e99ae9b9eff59cb1e, user_id=1f80196008c14157b3ed3e53228f56ca, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:36.970668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c24f05-46ae-4e72-a24d-10987a19a347 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:36.986743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 896/1786] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:36 2022] PUT /identity/v3/projects/acb6f60904cb484e99ae9b9eff59cb1e/users/1f80196008c14157b3ed3e53228f56ca/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:36.998054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dad6db-644d-4964-9d88-01a72b0963cb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:36.999094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dad6db-644d-4964-9d88-01a72b0963cb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:36.999432 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dad6db-644d-4964-9d88-01a72b0963cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:37.030505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-04dad6db-644d-4964-9d88-01a72b0963cb None None] MFA Rules not processed for user `1f80196008c14157b3ed3e53228f56ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:37.031780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-04dad6db-644d-4964-9d88-01a72b0963cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:37.126020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 891/1787] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:35:37.141985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c24f05-46ae-4e72-a24d-10987a19a347 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:37.143781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-14c24f05-46ae-4e72-a24d-10987a19a347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:37.280429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c24f05-46ae-4e72-a24d-10987a19a347 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:37.285588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c725b87-06dc-4ef9-814b-53bd31346a47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b71b778b0b24cbb92446070934d68ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:37.286762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c725b87-06dc-4ef9-814b-53bd31346a47 service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:37.287232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c725b87-06dc-4ef9-814b-53bd31346a47 service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:37.287690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c725b87-06dc-4ef9-814b-53bd31346a47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:37.297958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c725b87-06dc-4ef9-814b-53bd31346a47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:37.299962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c725b87-06dc-4ef9-814b-53bd31346a47 service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:37.316817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 897/1788] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:37.384207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51c91c-3bea-4d8a-8180-8b73435c2322 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:37.384598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51c91c-3bea-4d8a-8180-8b73435c2322 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:37.384984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51c91c-3bea-4d8a-8180-8b73435c2322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:37.407745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4e51c91c-3bea-4d8a-8180-8b73435c2322 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:37.408988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4e51c91c-3bea-4d8a-8180-8b73435c2322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:37.416051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:37.468003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 892/1789] 10.222.0.20 () {58 vars in 967 bytes} [Wed Nov 2 03:35:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:37.482254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c725b87-06dc-4ef9-814b-53bd31346a47 service glance] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:37.519656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:37.555170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c725b87-06dc-4ef9-814b-53bd31346a47 service glance] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:37.560578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709e45-37e8-459c-b191-876e62eeb25f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:37.561189 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709e45-37e8-459c-b191-876e62eeb25f service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:37.561471 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709e45-37e8-459c-b191-876e62eeb25f service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:37.561741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709e45-37e8-459c-b191-876e62eeb25f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:37.571292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9709e45-37e8-459c-b191-876e62eeb25f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:37.572939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9709e45-37e8-459c-b191-876e62eeb25f service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:37.582490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 898/1790] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:35:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:35:37.843103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f2b49-23f5-43df-bfca-464eff03e7e7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:37.843596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f2b49-23f5-43df-bfca-464eff03e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:37.843596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f2b49-23f5-43df-bfca-464eff03e7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:37.862944 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-943f2b49-23f5-43df-bfca-464eff03e7e7 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:37.864123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-943f2b49-23f5-43df-bfca-464eff03e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:37.871142 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 893/1791] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:35:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:37.884357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709e45-37e8-459c-b191-876e62eeb25f service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:37.895470 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709e45-37e8-459c-b191-876e62eeb25f service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:37.900549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7d168-c077-4d29-abdb-ee86cbd51b0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:37.901139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7d168-c077-4d29-abdb-ee86cbd51b0c service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:37.901423 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7d168-c077-4d29-abdb-ee86cbd51b0c service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:37.901688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7d168-c077-4d29-abdb-ee86cbd51b0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:37.909659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7d168-c077-4d29-abdb-ee86cbd51b0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:37.911529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7d168-c077-4d29-abdb-ee86cbd51b0c service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:37.919886 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 899/1792] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:35:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 03:35:38.248820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158121df-7fdd-4aaf-b822-29e400e15227 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:38.249110 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158121df-7fdd-4aaf-b822-29e400e15227 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:38.249382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158121df-7fdd-4aaf-b822-29e400e15227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:38.268827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-158121df-7fdd-4aaf-b822-29e400e15227 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:38.270017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-158121df-7fdd-4aaf-b822-29e400e15227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:38.278068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 894/1793] 10.222.0.20 () {58 vars in 967 bytes} [Wed Nov 2 03:35:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:38.293023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7d168-c077-4d29-abdb-ee86cbd51b0c service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:38.305327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7d168-c077-4d29-abdb-ee86cbd51b0c service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:38.311464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ac90a-5cbd-4d78-94e4-53d262b9d174 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:38.312118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac90a-5cbd-4d78-94e4-53d262b9d174 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:38.312399 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac90a-5cbd-4d78-94e4-53d262b9d174 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:38.312710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac90a-5cbd-4d78-94e4-53d262b9d174 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:38.327378 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ac90a-5cbd-4d78-94e4-53d262b9d174 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:38.329205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ac90a-5cbd-4d78-94e4-53d262b9d174 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:38.339893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 900/1794] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:35:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:35:38.575357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158121df-7fdd-4aaf-b822-29e400e15227 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:38.580630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-158121df-7fdd-4aaf-b822-29e400e15227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:38.645300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158121df-7fdd-4aaf-b822-29e400e15227 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:38.648992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214850ee-9bc8-4165-b529-e5c505e66121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:38.649706 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214850ee-9bc8-4165-b529-e5c505e66121 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:38.649988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214850ee-9bc8-4165-b529-e5c505e66121 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:38.650263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214850ee-9bc8-4165-b529-e5c505e66121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:38.652431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-214850ee-9bc8-4165-b529-e5c505e66121 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:38.718174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214850ee-9bc8-4165-b529-e5c505e66121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:38.719606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214850ee-9bc8-4165-b529-e5c505e66121 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:38.730616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 895/1795] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:39.426671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ac90a-5cbd-4d78-94e4-53d262b9d174 service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:39.435892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ac90a-5cbd-4d78-94e4-53d262b9d174 service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:39.443522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cd4e6-fb2c-46bb-84c2-f228cf2b253b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:39.444144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cd4e6-fb2c-46bb-84c2-f228cf2b253b service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:39.444441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cd4e6-fb2c-46bb-84c2-f228cf2b253b service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:39.444740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cd4e6-fb2c-46bb-84c2-f228cf2b253b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:39.519266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cd4e6-fb2c-46bb-84c2-f228cf2b253b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:39.519266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cd4e6-fb2c-46bb-84c2-f228cf2b253b service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:39.530200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 901/1796] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:40.755432 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214850ee-9bc8-4165-b529-e5c505e66121 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:40.757030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-214850ee-9bc8-4165-b529-e5c505e66121 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:40.826020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:40.834222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214850ee-9bc8-4165-b529-e5c505e66121 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:40.838712 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:40.839349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:40.839634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:40.839905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] PATH_INFO: `/v3/users/535409073a004b98ae95c26461f7d32b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:40.841076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=535409073a004b98ae95c26461f7d32b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:40.843051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:40.904487 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '535409073a004b98ae95c26461f7d32b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:40.905247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '535409073a004b98ae95c26461f7d32b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:40.913182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '535409073a004b98ae95c26461f7d32b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:40.913927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '535409073a004b98ae95c26461f7d32b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:40.926996 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '535409073a004b98ae95c26461f7d32b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:40.951161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 896/1797] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:40 2022] DELETE /identity/v3/users/535409073a004b98ae95c26461f7d32b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:40.955811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9d69a-81cd-426c-8a21-221a913efc6d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:40.956829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9d69a-81cd-426c-8a21-221a913efc6d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:40.956998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9d69a-81cd-426c-8a21-221a913efc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:40.983768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fbe9d69a-81cd-426c-8a21-221a913efc6d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:40.986178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fbe9d69a-81cd-426c-8a21-221a913efc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:41.076625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 902/1798] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:41.086482 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:41.088123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:41.148047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229242f8-cb0d-4212-b67b-7304de267cfc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:41.151752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f5e0a-4577-420c-9b43-3addcbbdf856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:41.152350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f5e0a-4577-420c-9b43-3addcbbdf856 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.152668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f5e0a-4577-420c-9b43-3addcbbdf856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.152956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f5e0a-4577-420c-9b43-3addcbbdf856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.162015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f5e0a-4577-420c-9b43-3addcbbdf856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:41.163375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f5e0a-4577-420c-9b43-3addcbbdf856 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:41.172777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 897/1799] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:41.350832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9d69a-81cd-426c-8a21-221a913efc6d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:41.352555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fbe9d69a-81cd-426c-8a21-221a913efc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:41.371596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9d69a-81cd-426c-8a21-221a913efc6d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:41.377927 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:41.378804 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.379085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.379358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] PATH_INFO: `/v3/projects/5ab2bf048eb54b2e941e616f644c7bc0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.380529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab2bf048eb54b2e941e616f644c7bc0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:41.382605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:41.416621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:41.442199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab2bf048eb54b2e941e616f644c7bc0', 'request_id': 'req-9c238855-d9ea-4ee4-b16d-aa60479edc8b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:41.448947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab2bf048eb54b2e941e616f644c7bc0', 'request_id': 'req-9c238855-d9ea-4ee4-b16d-aa60479edc8b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:41.457074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab2bf048eb54b2e941e616f644c7bc0', 'request_id': 'req-9c238855-d9ea-4ee4-b16d-aa60479edc8b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:41.468163 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] The token cache is being invalidate because project 5ab2bf048eb54b2e941e616f644c7bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:41.468596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:41.469274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9c238855-d9ea-4ee4-b16d-aa60479edc8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:41.470843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 903/1800] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:41 2022] DELETE /identity/v3/projects/5ab2bf048eb54b2e941e616f644c7bc0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:41.476249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a72b1-b9af-4b8e-9ddb-ec9af5963c56 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.476554 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a72b1-b9af-4b8e-9ddb-ec9af5963c56 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.476831 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a72b1-b9af-4b8e-9ddb-ec9af5963c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.498578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2a8a72b1-b9af-4b8e-9ddb-ec9af5963c56 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:41.500062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2a8a72b1-b9af-4b8e-9ddb-ec9af5963c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:41.567592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 898/1801] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:41.575034 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077ca69-3977-4544-96e1-decff2d3845e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.575425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077ca69-3977-4544-96e1-decff2d3845e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.575766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077ca69-3977-4544-96e1-decff2d3845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.597215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b077ca69-3977-4544-96e1-decff2d3845e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:41.598468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b077ca69-3977-4544-96e1-decff2d3845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:41.606503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 904/1802] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:41.610762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a72b1-b9af-4b8e-9ddb-ec9af5963c56 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:41.622361 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a72b1-b9af-4b8e-9ddb-ec9af5963c56 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:41.627054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59f211-1be2-446b-8e82-649f1f915b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:41.627673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59f211-1be2-446b-8e82-649f1f915b89 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.628006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59f211-1be2-446b-8e82-649f1f915b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.628524 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59f211-1be2-446b-8e82-649f1f915b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.629356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59f211-1be2-446b-8e82-649f1f915b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:41.629662 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59f211-1be2-446b-8e82-649f1f915b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:41.631266 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59f211-1be2-446b-8e82-649f1f915b89 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:41.642823 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 899/1803] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:35:41.647770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077ca69-3977-4544-96e1-decff2d3845e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:41.657014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077ca69-3977-4544-96e1-decff2d3845e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:41.662449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fbeaf-8230-4a96-9502-4ab1821315e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:41.663043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fbeaf-8230-4a96-9502-4ab1821315e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.663322 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fbeaf-8230-4a96-9502-4ab1821315e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.663594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fbeaf-8230-4a96-9502-4ab1821315e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.664210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fbeaf-8230-4a96-9502-4ab1821315e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:41.666135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fbeaf-8230-4a96-9502-4ab1821315e5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:41.693083 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 905/1804] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:41 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:41.697280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59f211-1be2-446b-8e82-649f1f915b89 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:41.703572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:41.708113 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59f211-1be2-446b-8e82-649f1f915b89 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:41.766066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7b93b-65c4-4e53-8089-78d15277345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:41.766745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7b93b-65c4-4e53-8089-78d15277345a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.766955 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7b93b-65c4-4e53-8089-78d15277345a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.767222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7b93b-65c4-4e53-8089-78d15277345a admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.767865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7b93b-65c4-4e53-8089-78d15277345a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:41.770465 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7b93b-65c4-4e53-8089-78d15277345a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:41.792527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 900/1805] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:41 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:41.796625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fbeaf-8230-4a96-9502-4ab1821315e5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:41.807925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fbeaf-8230-4a96-9502-4ab1821315e5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:41.812755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98495f1a-6d2a-4f4d-bec6-21a06205e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:41.813344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98495f1a-6d2a-4f4d-bec6-21a06205e794 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.813620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98495f1a-6d2a-4f4d-bec6-21a06205e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.813888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98495f1a-6d2a-4f4d-bec6-21a06205e794 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.814527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98495f1a-6d2a-4f4d-bec6-21a06205e794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:41.816821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98495f1a-6d2a-4f4d-bec6-21a06205e794 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:41.827339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 906/1806] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:41.831574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7b93b-65c4-4e53-8089-78d15277345a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:41.841520 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7b93b-65c4-4e53-8089-78d15277345a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:41.846109 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f5c4f-6b2a-46f7-b4b8-7a21640293a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:41.846710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f5c4f-6b2a-46f7-b4b8-7a21640293a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.846990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f5c4f-6b2a-46f7-b4b8-7a21640293a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.847264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f5c4f-6b2a-46f7-b4b8-7a21640293a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.847902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f5c4f-6b2a-46f7-b4b8-7a21640293a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:41.849545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f5c4f-6b2a-46f7-b4b8-7a21640293a6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:41.861018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 901/1807] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:41.865938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98495f1a-6d2a-4f4d-bec6-21a06205e794 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:41.875671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98495f1a-6d2a-4f4d-bec6-21a06205e794 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:41.881318 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc9a5-8efe-4c4c-ad87-cbc227e40fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:41.881984 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc9a5-8efe-4c4c-ad87-cbc227e40fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.882263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc9a5-8efe-4c4c-ad87-cbc227e40fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.882534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc9a5-8efe-4c4c-ad87-cbc227e40fa7 admin admin] PATH_INFO: `/v3/projects/432df74d9b2c4190bc69d1c588a37ac0/users/6efb487b68c4479b835517a9445578e0/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.897388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fc9a5-8efe-4c4c-ad87-cbc227e40fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432df74d9b2c4190bc69d1c588a37ac0, user_id=6efb487b68c4479b835517a9445578e0, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:41.900012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fc9a5-8efe-4c4c-ad87-cbc227e40fa7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:41.912855 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 907/1808] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:41 2022] PUT /identity/v3/projects/432df74d9b2c4190bc69d1c588a37ac0/users/6efb487b68c4479b835517a9445578e0/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:41.918119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259aa72-1a7b-42cf-a94d-50b3fbf03f14 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:41.918478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259aa72-1a7b-42cf-a94d-50b3fbf03f14 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:41.918782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259aa72-1a7b-42cf-a94d-50b3fbf03f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:41.939602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7259aa72-1a7b-42cf-a94d-50b3fbf03f14 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:41.940886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7259aa72-1a7b-42cf-a94d-50b3fbf03f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:42.001997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 902/1809] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:42.017371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc9a5-8efe-4c4c-ad87-cbc227e40fa7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:42.019997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-836fc9a5-8efe-4c4c-ad87-cbc227e40fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:42.117446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc9a5-8efe-4c4c-ad87-cbc227e40fa7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:42.132171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf8f2-0bf1-434e-86e9-57f3e5693642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:42.133188 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf8f2-0bf1-434e-86e9-57f3e5693642 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:42.133471 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf8f2-0bf1-434e-86e9-57f3e5693642 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:42.134491 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf8f2-0bf1-434e-86e9-57f3e5693642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:42.145569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebf8f2-0bf1-434e-86e9-57f3e5693642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:42.147060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebf8f2-0bf1-434e-86e9-57f3e5693642 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:42.157150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 908/1810] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:42.798696 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28372c5-74ec-48c1-b905-1ca936c058ea None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:42.799214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28372c5-74ec-48c1-b905-1ca936c058ea None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:42.800070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28372c5-74ec-48c1-b905-1ca936c058ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:42.838273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b28372c5-74ec-48c1-b905-1ca936c058ea None None] MFA Rules not processed for user `6efb487b68c4479b835517a9445578e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:42.839493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b28372c5-74ec-48c1-b905-1ca936c058ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:42.913237 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 903/1811] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:42.923970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf8f2-0bf1-434e-86e9-57f3e5693642 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:42.926721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-00ebf8f2-0bf1-434e-86e9-57f3e5693642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:42.988777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf8f2-0bf1-434e-86e9-57f3e5693642 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:42.991990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ceb79e-bea4-4d62-a1c5-8fdf2fe07930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:42.992644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceb79e-bea4-4d62-a1c5-8fdf2fe07930 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:42.992924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceb79e-bea4-4d62-a1c5-8fdf2fe07930 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:42.993194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceb79e-bea4-4d62-a1c5-8fdf2fe07930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:42.998554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:43.004086 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ceb79e-bea4-4d62-a1c5-8fdf2fe07930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:43.005821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ceb79e-bea4-4d62-a1c5-8fdf2fe07930 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:43.015493 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 909/1812] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:35:43.692155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28372c5-74ec-48c1-b905-1ca936c058ea None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:43.693588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b28372c5-74ec-48c1-b905-1ca936c058ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:43.707393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28372c5-74ec-48c1-b905-1ca936c058ea None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:43.711844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:43.712477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:43.712762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:43.713031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] PATH_INFO: `/v3/users/c0d62866dcb042e58c6ac5f34d2c32ec` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:43.714127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d62866dcb042e58c6ac5f34d2c32ec)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:43.716016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:43.722115 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:43.766505 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d62866dcb042e58c6ac5f34d2c32ec'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:43.767070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d62866dcb042e58c6ac5f34d2c32ec'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:43.775202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d62866dcb042e58c6ac5f34d2c32ec'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:43.775925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d62866dcb042e58c6ac5f34d2c32ec'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:43.789260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d62866dcb042e58c6ac5f34d2c32ec'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:43.803966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 904/1813] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:43 2022] DELETE /identity/v3/users/c0d62866dcb042e58c6ac5f34d2c32ec => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:43.808497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842aaa-88e9-45a2-9793-1d5982b6d475 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:43.808887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842aaa-88e9-45a2-9793-1d5982b6d475 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:43.809136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842aaa-88e9-45a2-9793-1d5982b6d475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:43.829060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-52842aaa-88e9-45a2-9793-1d5982b6d475 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:43.830278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-52842aaa-88e9-45a2-9793-1d5982b6d475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:43.891144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 910/1814] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:43.901174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:43.902599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:43.960071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848899b-e1dc-492a-9e00-98acd2b2c305 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:43.963675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90332f78-791e-4a58-9bc9-75f4188ff0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:43.964278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332f78-791e-4a58-9bc9-75f4188ff0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:43.964588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332f78-791e-4a58-9bc9-75f4188ff0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:43.964861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332f78-791e-4a58-9bc9-75f4188ff0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:43.975629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90332f78-791e-4a58-9bc9-75f4188ff0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:43.977126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90332f78-791e-4a58-9bc9-75f4188ff0d3 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:43.986877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 905/1815] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:44.267246 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842aaa-88e9-45a2-9793-1d5982b6d475 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:44.269309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-52842aaa-88e9-45a2-9793-1d5982b6d475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:44.281648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842aaa-88e9-45a2-9793-1d5982b6d475 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:44.286960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:44.287599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:44.287878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:44.288150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] PATH_INFO: `/v3/projects/d47879d646a34df991d7b043a521e4fb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:44.289301 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47879d646a34df991d7b043a521e4fb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:44.291191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:44.343721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47879d646a34df991d7b043a521e4fb', 'request_id': 'req-b362f933-a5f9-4efd-95da-b3827d6cd46d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:44.354889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47879d646a34df991d7b043a521e4fb', 'request_id': 'req-b362f933-a5f9-4efd-95da-b3827d6cd46d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:44.362317 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47879d646a34df991d7b043a521e4fb', 'request_id': 'req-b362f933-a5f9-4efd-95da-b3827d6cd46d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:44.380078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] The token cache is being invalidate because project d47879d646a34df991d7b043a521e4fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:44.380626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:44.381564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b362f933-a5f9-4efd-95da-b3827d6cd46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:44.383334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 911/1816] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:44 2022] DELETE /identity/v3/projects/d47879d646a34df991d7b043a521e4fb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:44.387448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90332f78-791e-4a58-9bc9-75f4188ff0d3 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:44.399131 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90332f78-791e-4a58-9bc9-75f4188ff0d3 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:44.409591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078141c3-8390-4704-b033-54c44ebd5fa5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:44.409962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078141c3-8390-4704-b033-54c44ebd5fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:44.410301 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078141c3-8390-4704-b033-54c44ebd5fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:44.433254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-078141c3-8390-4704-b033-54c44ebd5fa5 None None] MFA Rules not processed for user `6efb487b68c4479b835517a9445578e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:44.435272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-078141c3-8390-4704-b033-54c44ebd5fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:44.467710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:44.468386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:44.468769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:44.469701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] PATH_INFO: `/v3/users/ac1883883fec45fd97ef2865da959e7a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:44.471815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1883883fec45fd97ef2865da959e7a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:44.474519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:44.503444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 912/1817] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:44.526491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:44.545084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1883883fec45fd97ef2865da959e7a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:44.545997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1883883fec45fd97ef2865da959e7a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:44.558473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1883883fec45fd97ef2865da959e7a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:44.559279 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1883883fec45fd97ef2865da959e7a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:44.574566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1883883fec45fd97ef2865da959e7a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:44.589821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 906/1818] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:44 2022] DELETE /identity/v3/users/ac1883883fec45fd97ef2865da959e7a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:44.895774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078141c3-8390-4704-b033-54c44ebd5fa5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:44.897461 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-078141c3-8390-4704-b033-54c44ebd5fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:44.925961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078141c3-8390-4704-b033-54c44ebd5fa5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:44.954108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:45.008525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:45.009327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:45.009752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:45.009967 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] PATH_INFO: `/v3/projects/c270d96a4c1c4d009fcc707d88027040` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:45.011255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c270d96a4c1c4d009fcc707d88027040)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:45.013963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:45.091667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c270d96a4c1c4d009fcc707d88027040', 'request_id': 'req-71f82707-0782-48ea-9da5-cd68b03bce69'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.106082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c270d96a4c1c4d009fcc707d88027040', 'request_id': 'req-71f82707-0782-48ea-9da5-cd68b03bce69'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.115855 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c270d96a4c1c4d009fcc707d88027040', 'request_id': 'req-71f82707-0782-48ea-9da5-cd68b03bce69'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.130704 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] The token cache is being invalidate because project c270d96a4c1c4d009fcc707d88027040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:45.131332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.132204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.140334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 913/1819] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:44 2022] DELETE /identity/v3/projects/c270d96a4c1c4d009fcc707d88027040 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:35:45.141745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:45.144108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:45.161937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634a991-a2c7-4be2-9552-86e54338777b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:45.274615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:45.275754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:45.275935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:45.276220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] PATH_INFO: `/v3/users/c0b854bc53a54c39b2c21fd5d46cd23a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:45.277431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b854bc53a54c39b2c21fd5d46cd23a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:45.279451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:45.353829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b854bc53a54c39b2c21fd5d46cd23a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.354485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b854bc53a54c39b2c21fd5d46cd23a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.363064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b854bc53a54c39b2c21fd5d46cd23a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.363930 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b854bc53a54c39b2c21fd5d46cd23a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.377047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f4b80827-d346-4435-b3ff-f1156d36ed48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b854bc53a54c39b2c21fd5d46cd23a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.390443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 907/1820] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:35:45 2022] DELETE /identity/v3/users/c0b854bc53a54c39b2c21fd5d46cd23a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:45.675603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:45.677046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:45.691429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f82707-0782-48ea-9da5-cd68b03bce69 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:45.768138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:45.769486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:45.769762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:45.770033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] PATH_INFO: `/v3/projects/0f60efb90fe940afb887a7fa6d1a30a3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:45.771736 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f60efb90fe940afb887a7fa6d1a30a3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:45.773693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:45.829887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f60efb90fe940afb887a7fa6d1a30a3', 'request_id': 'req-c9dcc153-c795-4ac1-9a84-58022ac788a7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.834339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:45.837549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f60efb90fe940afb887a7fa6d1a30a3', 'request_id': 'req-c9dcc153-c795-4ac1-9a84-58022ac788a7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.844959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f60efb90fe940afb887a7fa6d1a30a3', 'request_id': 'req-c9dcc153-c795-4ac1-9a84-58022ac788a7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.858979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] The token cache is being invalidate because project 0f60efb90fe940afb887a7fa6d1a30a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:35:45.859273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.859917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c9dcc153-c795-4ac1-9a84-58022ac788a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:35:45.861439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 914/1821] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:35:45 2022] DELETE /identity/v3/projects/0f60efb90fe940afb887a7fa6d1a30a3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:45.867707 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d7b56-7470-49ca-8954-1a21f2d135b4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:45.868002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d7b56-7470-49ca-8954-1a21f2d135b4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:45.868617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d7b56-7470-49ca-8954-1a21f2d135b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:45.888600 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9e7d7b56-7470-49ca-8954-1a21f2d135b4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:45.889798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9e7d7b56-7470-49ca-8954-1a21f2d135b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:45.913675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:45.962450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 908/1822] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:45.972070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf7a9e-a6c0-45ae-8312-e833a7669592 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:45.972652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf7a9e-a6c0-45ae-8312-e833a7669592 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:45.972746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf7a9e-a6c0-45ae-8312-e833a7669592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:45.994715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ffdf7a9e-a6c0-45ae-8312-e833a7669592 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:45.995997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ffdf7a9e-a6c0-45ae-8312-e833a7669592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:46.005601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 915/1823] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:46.009701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d7b56-7470-49ca-8954-1a21f2d135b4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:46.020401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d7b56-7470-49ca-8954-1a21f2d135b4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:46.025460 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1811-a288-41d3-bfe9-2761459c84c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:46.026069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1811-a288-41d3-bfe9-2761459c84c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:46.026347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1811-a288-41d3-bfe9-2761459c84c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:46.026625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1811-a288-41d3-bfe9-2761459c84c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:46.027273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1811-a288-41d3-bfe9-2761459c84c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:35:46.027582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1811-a288-41d3-bfe9-2761459c84c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:46.029241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1811-a288-41d3-bfe9-2761459c84c5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:46.046893 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 909/1824] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:35:46.048058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf7a9e-a6c0-45ae-8312-e833a7669592 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:46.059723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf7a9e-a6c0-45ae-8312-e833a7669592 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:46.064768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b49bf-44cd-4ed6-8c90-0a051c083804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:46.065906 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b49bf-44cd-4ed6-8c90-0a051c083804 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:46.066188 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b49bf-44cd-4ed6-8c90-0a051c083804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:46.066445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b49bf-44cd-4ed6-8c90-0a051c083804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:46.067084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b49bf-44cd-4ed6-8c90-0a051c083804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:46.068992 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b49bf-44cd-4ed6-8c90-0a051c083804 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:46.101315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 916/1825] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:35:46 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:35:46.105580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1811-a288-41d3-bfe9-2761459c84c5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:46.116720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1811-a288-41d3-bfe9-2761459c84c5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:46.179164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e725d9f-49e5-4cfe-97b3-2355846be18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:46.179796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e725d9f-49e5-4cfe-97b3-2355846be18c admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:46.180039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e725d9f-49e5-4cfe-97b3-2355846be18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:46.180311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e725d9f-49e5-4cfe-97b3-2355846be18c admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:46.180975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e725d9f-49e5-4cfe-97b3-2355846be18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:46.182878 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e725d9f-49e5-4cfe-97b3-2355846be18c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:46.207821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 910/1826] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:35:46 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:35:46.209207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b49bf-44cd-4ed6-8c90-0a051c083804 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:46.220403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b49bf-44cd-4ed6-8c90-0a051c083804 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:46.225095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb2953-398d-4dfd-8193-7932e070fce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:46.225705 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb2953-398d-4dfd-8193-7932e070fce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:46.225987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb2953-398d-4dfd-8193-7932e070fce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:46.226260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb2953-398d-4dfd-8193-7932e070fce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:46.226908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb2953-398d-4dfd-8193-7932e070fce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:46.228518 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb2953-398d-4dfd-8193-7932e070fce2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:46.239180 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 917/1827] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:46.243024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e725d9f-49e5-4cfe-97b3-2355846be18c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:46.254323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e725d9f-49e5-4cfe-97b3-2355846be18c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:46.259840 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f60b-df53-4b53-ad57-90729d7585b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:46.260741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f60b-df53-4b53-ad57-90729d7585b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:46.261043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f60b-df53-4b53-ad57-90729d7585b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:46.261311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f60b-df53-4b53-ad57-90729d7585b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:46.262401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f60b-df53-4b53-ad57-90729d7585b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:46.264413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f60b-df53-4b53-ad57-90729d7585b2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:46.276157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 911/1828] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:35:46.286863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb2953-398d-4dfd-8193-7932e070fce2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:46.296100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb2953-398d-4dfd-8193-7932e070fce2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:46.303494 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860666b-96d9-4a17-afb7-9b641b55ec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:46.304174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860666b-96d9-4a17-afb7-9b641b55ec19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:46.304454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860666b-96d9-4a17-afb7-9b641b55ec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:46.304747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860666b-96d9-4a17-afb7-9b641b55ec19 admin admin] PATH_INFO: `/v3/projects/325aba3c469a456fb9c19eb51bab685a/users/b69a114040224ea7a7d21ace8f074bc3/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:46.322495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860666b-96d9-4a17-afb7-9b641b55ec19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325aba3c469a456fb9c19eb51bab685a, user_id=b69a114040224ea7a7d21ace8f074bc3, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:46.323912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860666b-96d9-4a17-afb7-9b641b55ec19 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:46.340595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 918/1829] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:35:46 2022] PUT /identity/v3/projects/325aba3c469a456fb9c19eb51bab685a/users/b69a114040224ea7a7d21ace8f074bc3/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:35:46.345233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525193-a826-4e93-bae1-e2459897a2f8 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:46.345618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525193-a826-4e93-bae1-e2459897a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:46.345788 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525193-a826-4e93-bae1-e2459897a2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:46.365759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7e525193-a826-4e93-bae1-e2459897a2f8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:46.366959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7e525193-a826-4e93-bae1-e2459897a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:46.448345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 912/1830] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:46.458768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860666b-96d9-4a17-afb7-9b641b55ec19 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:46.461536 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1860666b-96d9-4a17-afb7-9b641b55ec19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:46.540884 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860666b-96d9-4a17-afb7-9b641b55ec19 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:46.544539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5052e-4c69-4f45-990f-5b29ab628366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:46.545155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5052e-4c69-4f45-990f-5b29ab628366 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:46.545435 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5052e-4c69-4f45-990f-5b29ab628366 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:46.545711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5052e-4c69-4f45-990f-5b29ab628366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:46.555861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5052e-4c69-4f45-990f-5b29ab628366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:46.557323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5052e-4c69-4f45-990f-5b29ab628366 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:46.568017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 919/1831] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:48.233048 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d3a4e-a9ed-4133-8d63-679ee044d4c4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:48.233545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d3a4e-a9ed-4133-8d63-679ee044d4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:48.233753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d3a4e-a9ed-4133-8d63-679ee044d4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:48.270828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ff6d3a4e-a9ed-4133-8d63-679ee044d4c4 None None] MFA Rules not processed for user `b69a114040224ea7a7d21ace8f074bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:48.272705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ff6d3a4e-a9ed-4133-8d63-679ee044d4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:48.294218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:48.360651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 913/1832] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:35:48.374134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5052e-4c69-4f45-990f-5b29ab628366 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:35:48.376371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-27c5052e-4c69-4f45-990f-5b29ab628366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:48.446642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5052e-4c69-4f45-990f-5b29ab628366 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:35:48.450602 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7e54f-8abb-4acf-9875-81e09af1f7ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:35:48.451287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7e54f-8abb-4acf-9875-81e09af1f7ae service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:48.451568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7e54f-8abb-4acf-9875-81e09af1f7ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:48.451837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7e54f-8abb-4acf-9875-81e09af1f7ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:48.465395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7e54f-8abb-4acf-9875-81e09af1f7ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:35:48.466843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7e54f-8abb-4acf-9875-81e09af1f7ae service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:35:48.476798 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 920/1833] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:35:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:35:49.886886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1fea-c4d0-4b58-bfbf-3ac8095df3c5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:35:49.887366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1fea-c4d0-4b58-bfbf-3ac8095df3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:35:49.887479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1fea-c4d0-4b58-bfbf-3ac8095df3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:35:49.906947 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6dfc1fea-c4d0-4b58-bfbf-3ac8095df3c5 None None] MFA Rules not processed for user `b69a114040224ea7a7d21ace8f074bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:35:49.908153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6dfc1fea-c4d0-4b58-bfbf-3ac8095df3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:35:49.915296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 914/1834] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:35:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:35:58.472820 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=2,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:35:59.903983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=20 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:00.509479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7e54f-8abb-4acf-9875-81e09af1f7ae service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:00.510938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5cb7e54f-8abb-4acf-9875-81e09af1f7ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:00.525912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7e54f-8abb-4acf-9875-81e09af1f7ae service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:00.530621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:00.531256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:00.531539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:00.531817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] PATH_INFO: `/v3/users/1f80196008c14157b3ed3e53228f56ca` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:00.532969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f80196008c14157b3ed3e53228f56ca)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:00.535707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:00.587130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f80196008c14157b3ed3e53228f56ca'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:00.587877 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f80196008c14157b3ed3e53228f56ca'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:00.595511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f80196008c14157b3ed3e53228f56ca'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:00.603874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f80196008c14157b3ed3e53228f56ca'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:00.604588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f80196008c14157b3ed3e53228f56ca'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:00.624692 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 921/1835] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:36:00 2022] DELETE /identity/v3/users/1f80196008c14157b3ed3e53228f56ca => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:00.629851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc281b4-8399-459a-a4d8-ae8733e8a887 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:00.630182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc281b4-8399-459a-a4d8-ae8733e8a887 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:00.630589 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc281b4-8399-459a-a4d8-ae8733e8a887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:00.651009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0fc281b4-8399-459a-a4d8-ae8733e8a887 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:00.652232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0fc281b4-8399-459a-a4d8-ae8733e8a887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:00.714946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 915/1836] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:00.724946 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:00.726360 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:00.787497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bfa81-5cf5-4e19-9718-445eb3704d48 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:00.791230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01304cb-e22c-46f0-89f0-497dd040bc18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:00.791845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01304cb-e22c-46f0-89f0-497dd040bc18 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:00.792165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01304cb-e22c-46f0-89f0-497dd040bc18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:00.792602 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01304cb-e22c-46f0-89f0-497dd040bc18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:00.802643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01304cb-e22c-46f0-89f0-497dd040bc18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:00.804070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01304cb-e22c-46f0-89f0-497dd040bc18 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:00.819031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 922/1837] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:36:01.095676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc281b4-8399-459a-a4d8-ae8733e8a887 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:01.097437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0fc281b4-8399-459a-a4d8-ae8733e8a887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:01.112697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc281b4-8399-459a-a4d8-ae8733e8a887 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:01.117481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:01.118122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.118428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.118700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] PATH_INFO: `/v3/projects/acb6f60904cb484e99ae9b9eff59cb1e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.119841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb6f60904cb484e99ae9b9eff59cb1e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:01.121849 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:01.169291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb6f60904cb484e99ae9b9eff59cb1e', 'request_id': 'req-be2d33a1-f443-483a-8ced-83fb862049a1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:01.177232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb6f60904cb484e99ae9b9eff59cb1e', 'request_id': 'req-be2d33a1-f443-483a-8ced-83fb862049a1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:01.183627 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb6f60904cb484e99ae9b9eff59cb1e', 'request_id': 'req-be2d33a1-f443-483a-8ced-83fb862049a1'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:01.195326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] The token cache is being invalidate because project acb6f60904cb484e99ae9b9eff59cb1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:36:01.195609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:01.196234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-be2d33a1-f443-483a-8ced-83fb862049a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:01.197722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 916/1838] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:36:01 2022] DELETE /identity/v3/projects/acb6f60904cb484e99ae9b9eff59cb1e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:01.202557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd3f21-5e5a-4803-b29c-4e5da1d4e5da None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.202841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd3f21-5e5a-4803-b29c-4e5da1d4e5da None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.203114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd3f21-5e5a-4803-b29c-4e5da1d4e5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.222251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e4fd3f21-5e5a-4803-b29c-4e5da1d4e5da None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:01.223371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e4fd3f21-5e5a-4803-b29c-4e5da1d4e5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:01.281816 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 923/1839] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:01.289602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8176d8-2e46-492e-acb5-47daae5b706a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.289894 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8176d8-2e46-492e-acb5-47daae5b706a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.290171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8176d8-2e46-492e-acb5-47daae5b706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.311043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-bd8176d8-2e46-492e-acb5-47daae5b706a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:01.312248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bd8176d8-2e46-492e-acb5-47daae5b706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:01.321053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 917/1840] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:01.325317 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd3f21-5e5a-4803-b29c-4e5da1d4e5da None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:01.335221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd3f21-5e5a-4803-b29c-4e5da1d4e5da None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:01.339672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dcb72-e024-4c5d-b489-c3f47546ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:01.340263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dcb72-e024-4c5d-b489-c3f47546ad23 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.340575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dcb72-e024-4c5d-b489-c3f47546ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.340854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dcb72-e024-4c5d-b489-c3f47546ad23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.341495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dcb72-e024-4c5d-b489-c3f47546ad23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:36:01.341797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dcb72-e024-4c5d-b489-c3f47546ad23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:01.343383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dcb72-e024-4c5d-b489-c3f47546ad23 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:01.355148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 924/1841] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:36:01.359276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8176d8-2e46-492e-acb5-47daae5b706a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:01.371582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8176d8-2e46-492e-acb5-47daae5b706a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:01.378253 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5afcf5-88e3-43cb-9b75-913a8c40ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:01.378858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5afcf5-88e3-43cb-9b75-913a8c40ce1a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.379136 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5afcf5-88e3-43cb-9b75-913a8c40ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.379406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5afcf5-88e3-43cb-9b75-913a8c40ce1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.380054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5afcf5-88e3-43cb-9b75-913a8c40ce1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:01.382097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5afcf5-88e3-43cb-9b75-913a8c40ce1a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:01.410224 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 918/1842] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:36:01 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:36:01.414428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dcb72-e024-4c5d-b489-c3f47546ad23 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:01.419515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:01.426298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dcb72-e024-4c5d-b489-c3f47546ad23 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:01.485195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb2ae4-0413-4c37-b7f6-f049fb2d267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:01.485726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2ae4-0413-4c37-b7f6-f049fb2d267c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.486004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2ae4-0413-4c37-b7f6-f049fb2d267c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.486276 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2ae4-0413-4c37-b7f6-f049fb2d267c admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.487863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb2ae4-0413-4c37-b7f6-f049fb2d267c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:01.489771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb2ae4-0413-4c37-b7f6-f049fb2d267c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:01.510674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 925/1843] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:36:01 2022] POST /identity/v3/users => generated 281 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:36:01.514845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5afcf5-88e3-43cb-9b75-913a8c40ce1a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:01.525197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5afcf5-88e3-43cb-9b75-913a8c40ce1a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:01.529757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d3ff5-f51b-47a4-bacb-401bb9b9f860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:01.530358 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d3ff5-f51b-47a4-bacb-401bb9b9f860 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.530643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d3ff5-f51b-47a4-bacb-401bb9b9f860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.531067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d3ff5-f51b-47a4-bacb-401bb9b9f860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.531715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d3ff5-f51b-47a4-bacb-401bb9b9f860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:01.533343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d3ff5-f51b-47a4-bacb-401bb9b9f860 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:01.543287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 919/1844] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:36:01.546880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb2ae4-0413-4c37-b7f6-f049fb2d267c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:01.558153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb2ae4-0413-4c37-b7f6-f049fb2d267c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:01.562835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ccd6-24f7-4b0a-ae2f-7bc311e96b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:01.563487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ccd6-24f7-4b0a-ae2f-7bc311e96b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.563770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ccd6-24f7-4b0a-ae2f-7bc311e96b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.564043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ccd6-24f7-4b0a-ae2f-7bc311e96b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.565386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99ccd6-24f7-4b0a-ae2f-7bc311e96b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:01.566962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99ccd6-24f7-4b0a-ae2f-7bc311e96b43 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:01.578000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 926/1845] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:36:01.582884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d3ff5-f51b-47a4-bacb-401bb9b9f860 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:01.597030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d3ff5-f51b-47a4-bacb-401bb9b9f860 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:01.603014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc598c-2480-48c9-b6a1-5978f966e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:01.603796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc598c-2480-48c9-b6a1-5978f966e1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.604179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc598c-2480-48c9-b6a1-5978f966e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.604920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc598c-2480-48c9-b6a1-5978f966e1e4 admin admin] PATH_INFO: `/v3/projects/851912661cbc485081ce5cdd88cb7735/users/685a046f9b824630ad78383c91a3d8d7/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.622037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc598c-2480-48c9-b6a1-5978f966e1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851912661cbc485081ce5cdd88cb7735, user_id=685a046f9b824630ad78383c91a3d8d7, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:01.624829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc598c-2480-48c9-b6a1-5978f966e1e4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:01.639500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 920/1846] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:36:01 2022] PUT /identity/v3/projects/851912661cbc485081ce5cdd88cb7735/users/685a046f9b824630ad78383c91a3d8d7/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:01.650885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4523e5-fb0c-43c2-996e-ed1bdc6caf92 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.651178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4523e5-fb0c-43c2-996e-ed1bdc6caf92 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.651455 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4523e5-fb0c-43c2-996e-ed1bdc6caf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.680781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8f4523e5-fb0c-43c2-996e-ed1bdc6caf92 None None] MFA Rules not processed for user `685a046f9b824630ad78383c91a3d8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:01.682004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8f4523e5-fb0c-43c2-996e-ed1bdc6caf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:01.750525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 927/1847] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:01.786324 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc598c-2480-48c9-b6a1-5978f966e1e4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:01.788237 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-82fc598c-2480-48c9-b6a1-5978f966e1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:01.823005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:01.856755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc598c-2480-48c9-b6a1-5978f966e1e4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:01.860478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19462d-e8f4-490b-b21b-babefbe29c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:01.861091 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19462d-e8f4-490b-b21b-babefbe29c3d service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.861376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19462d-e8f4-490b-b21b-babefbe29c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.861682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19462d-e8f4-490b-b21b-babefbe29c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.870815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19462d-e8f4-490b-b21b-babefbe29c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:01.872256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19462d-e8f4-490b-b21b-babefbe29c3d service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:01.881964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 921/1848] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:36:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:36:01.897727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4523e5-fb0c-43c2-996e-ed1bdc6caf92 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:01.960028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4523e5-fb0c-43c2-996e-ed1bdc6caf92 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:01.964552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:01.965182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:01.965558 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:01.965737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] PATH_INFO: `/v3/users/685a046f9b824630ad78383c91a3d8d7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:01.967014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=685a046f9b824630ad78383c91a3d8d7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:01.969010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:01.982096 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:02.015971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685a046f9b824630ad78383c91a3d8d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:02.016572 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685a046f9b824630ad78383c91a3d8d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:02.023508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685a046f9b824630ad78383c91a3d8d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:02.030026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685a046f9b824630ad78383c91a3d8d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:02.030730 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685a046f9b824630ad78383c91a3d8d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:02.048399 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 928/1849] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:36:01 2022] DELETE /identity/v3/users/685a046f9b824630ad78383c91a3d8d7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:02.053723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e665ebb-6291-468b-8bcd-4fc29e34009a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:02.054080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e665ebb-6291-468b-8bcd-4fc29e34009a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:02.054424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e665ebb-6291-468b-8bcd-4fc29e34009a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:02.074163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2e665ebb-6291-468b-8bcd-4fc29e34009a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:02.075345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2e665ebb-6291-468b-8bcd-4fc29e34009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:02.132710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 922/1850] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:02.142271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:02.143731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:02.202297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd615c4e-9c0c-4474-b613-b6c71565e575 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:02.205958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57637c64-ecb0-4f50-bb18-af108c1a8446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:02.206573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57637c64-ecb0-4f50-bb18-af108c1a8446 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:02.206855 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57637c64-ecb0-4f50-bb18-af108c1a8446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:02.207129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57637c64-ecb0-4f50-bb18-af108c1a8446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:02.216389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57637c64-ecb0-4f50-bb18-af108c1a8446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:02.217836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57637c64-ecb0-4f50-bb18-af108c1a8446 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:02.227466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 929/1851] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:36:02.676347 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e665ebb-6291-468b-8bcd-4fc29e34009a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:02.677820 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2e665ebb-6291-468b-8bcd-4fc29e34009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:02.689708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e665ebb-6291-468b-8bcd-4fc29e34009a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:02.694385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:02.695028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:02.695310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:02.695583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] PATH_INFO: `/v3/projects/851912661cbc485081ce5cdd88cb7735` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:02.696738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851912661cbc485081ce5cdd88cb7735)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:02.698645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:02.747446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851912661cbc485081ce5cdd88cb7735', 'request_id': 'req-ceb19b38-52a2-4862-a80f-6fbfd280d442'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:02.755046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851912661cbc485081ce5cdd88cb7735', 'request_id': 'req-ceb19b38-52a2-4862-a80f-6fbfd280d442'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:02.760664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851912661cbc485081ce5cdd88cb7735', 'request_id': 'req-ceb19b38-52a2-4862-a80f-6fbfd280d442'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:02.772550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] The token cache is being invalidate because project 851912661cbc485081ce5cdd88cb7735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:36:02.772840 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:02.774175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ceb19b38-52a2-4862-a80f-6fbfd280d442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:02.775153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 923/1852] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:36:02 2022] DELETE /identity/v3/projects/851912661cbc485081ce5cdd88cb7735 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:02.780788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652d8be-ba2f-400a-a0b8-985c7faf4ecc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:02.781220 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652d8be-ba2f-400a-a0b8-985c7faf4ecc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:02.781559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652d8be-ba2f-400a-a0b8-985c7faf4ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:02.804025 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2652d8be-ba2f-400a-a0b8-985c7faf4ecc None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:02.805340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2652d8be-ba2f-400a-a0b8-985c7faf4ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:02.878594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 930/1853] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:36:02.886586 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aa493-56d1-468d-a09c-1bfb73d8e8da None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:02.886873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aa493-56d1-468d-a09c-1bfb73d8e8da None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:02.887151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aa493-56d1-468d-a09c-1bfb73d8e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:02.907744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-751aa493-56d1-468d-a09c-1bfb73d8e8da None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:02.909552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-751aa493-56d1-468d-a09c-1bfb73d8e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:02.917535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 924/1854] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:02.922508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652d8be-ba2f-400a-a0b8-985c7faf4ecc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:02.933033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652d8be-ba2f-400a-a0b8-985c7faf4ecc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:02.937822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14052d-041b-41e2-8fda-ed6bb5d60a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:02.938426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14052d-041b-41e2-8fda-ed6bb5d60a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:02.938709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14052d-041b-41e2-8fda-ed6bb5d60a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:02.938988 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14052d-041b-41e2-8fda-ed6bb5d60a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:02.939723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14052d-041b-41e2-8fda-ed6bb5d60a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:36:02.940031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14052d-041b-41e2-8fda-ed6bb5d60a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:02.941648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14052d-041b-41e2-8fda-ed6bb5d60a5d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:02.954361 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 931/1855] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:36:02.959417 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aa493-56d1-468d-a09c-1bfb73d8e8da None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:02.969464 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aa493-56d1-468d-a09c-1bfb73d8e8da None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:02.975115 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59084b15-9b55-45ad-9336-e8979c79e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:02.975877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084b15-9b55-45ad-9336-e8979c79e629 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:02.976350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084b15-9b55-45ad-9336-e8979c79e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:02.976769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084b15-9b55-45ad-9336-e8979c79e629 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:02.977485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59084b15-9b55-45ad-9336-e8979c79e629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:02.979504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59084b15-9b55-45ad-9336-e8979c79e629 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:03.013369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14052d-041b-41e2-8fda-ed6bb5d60a5d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:03.014205 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 925/1856] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:36:02 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:36:03.026925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14052d-041b-41e2-8fda-ed6bb5d60a5d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:03.047386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:03.104177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbbabf-4adc-4d83-ab3f-95e5d64e1e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:03.104973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbbabf-4adc-4d83-ab3f-95e5d64e1e87 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:03.105282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbbabf-4adc-4d83-ab3f-95e5d64e1e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:03.105552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbbabf-4adc-4d83-ab3f-95e5d64e1e87 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:03.106230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbbabf-4adc-4d83-ab3f-95e5d64e1e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:03.108185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbbabf-4adc-4d83-ab3f-95e5d64e1e87 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:03.130665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 932/1857] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:36:03 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:36:03.134959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59084b15-9b55-45ad-9336-e8979c79e629 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:03.148330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59084b15-9b55-45ad-9336-e8979c79e629 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:03.153500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b2c9f-26f5-49f5-b1cb-6c11f691fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:03.154114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b2c9f-26f5-49f5-b1cb-6c11f691fa7a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:03.154395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b2c9f-26f5-49f5-b1cb-6c11f691fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:03.154672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b2c9f-26f5-49f5-b1cb-6c11f691fa7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:03.155317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b2c9f-26f5-49f5-b1cb-6c11f691fa7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:03.157155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b2c9f-26f5-49f5-b1cb-6c11f691fa7a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:03.169899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 926/1858] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:36:03.173909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbbabf-4adc-4d83-ab3f-95e5d64e1e87 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:03.183875 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbbabf-4adc-4d83-ab3f-95e5d64e1e87 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:03.189487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f017b-dbfb-456e-a984-468f8b2368aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:03.190667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f017b-dbfb-456e-a984-468f8b2368aa admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:03.191000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f017b-dbfb-456e-a984-468f8b2368aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:03.191615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f017b-dbfb-456e-a984-468f8b2368aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:03.191918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f017b-dbfb-456e-a984-468f8b2368aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:03.193674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f017b-dbfb-456e-a984-468f8b2368aa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:03.206402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 933/1859] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:36:03.210777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b2c9f-26f5-49f5-b1cb-6c11f691fa7a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:03.222291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b2c9f-26f5-49f5-b1cb-6c11f691fa7a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:03.228150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e25ef-4db2-49c0-9c08-c5952311d8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:03.228871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e25ef-4db2-49c0-9c08-c5952311d8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:03.229146 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e25ef-4db2-49c0-9c08-c5952311d8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:03.229427 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e25ef-4db2-49c0-9c08-c5952311d8a4 admin admin] PATH_INFO: `/v3/projects/06bddd675ea248fab6689843b8154bb3/users/25265bdff13a433183fc09a3c9a793fb/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:03.232737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:03.263061 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e25ef-4db2-49c0-9c08-c5952311d8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bddd675ea248fab6689843b8154bb3, user_id=25265bdff13a433183fc09a3c9a793fb, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:03.266862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e25ef-4db2-49c0-9c08-c5952311d8a4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:03.292133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 927/1860] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:36:03 2022] PUT /identity/v3/projects/06bddd675ea248fab6689843b8154bb3/users/25265bdff13a433183fc09a3c9a793fb/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:03.302686 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19644e-eda9-404e-9a00-b837d65fab1d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:03.302915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19644e-eda9-404e-9a00-b837d65fab1d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:03.303191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19644e-eda9-404e-9a00-b837d65fab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:03.331980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fb19644e-eda9-404e-9a00-b837d65fab1d None None] MFA Rules not processed for user `25265bdff13a433183fc09a3c9a793fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:03.333219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fb19644e-eda9-404e-9a00-b837d65fab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:03.397157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 934/1861] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:03.408741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e25ef-4db2-49c0-9c08-c5952311d8a4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:03.410500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-fc4e25ef-4db2-49c0-9c08-c5952311d8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:03.467196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e25ef-4db2-49c0-9c08-c5952311d8a4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:03.470977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49daf3-c908-4d5f-9ac6-9b7d7cad3bbd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b71b778b0b24cbb92446070934d68ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:03.471630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49daf3-c908-4d5f-9ac6-9b7d7cad3bbd service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:03.471912 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49daf3-c908-4d5f-9ac6-9b7d7cad3bbd service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:03.472187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49daf3-c908-4d5f-9ac6-9b7d7cad3bbd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:03.480336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49daf3-c908-4d5f-9ac6-9b7d7cad3bbd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:03.481826 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49daf3-c908-4d5f-9ac6-9b7d7cad3bbd service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:03.491222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 928/1862] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:36:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:36:13.394514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:13.486435 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:14.414861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b5bb3-7c4c-4ab8-8ca8-e81f7179599c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:14.415383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b5bb3-7c4c-4ab8-8ca8-e81f7179599c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:14.415383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b5bb3-7c4c-4ab8-8ca8-e81f7179599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:14.437556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a12b5bb3-7c4c-4ab8-8ca8-e81f7179599c None None] MFA Rules not processed for user `b69a114040224ea7a7d21ace8f074bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:14.439391 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a12b5bb3-7c4c-4ab8-8ca8-e81f7179599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:14.499826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 935/1863] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:17.503247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867fa42-ba77-44af-b697-7cbf15b90e3a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:17.503726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867fa42-ba77-44af-b697-7cbf15b90e3a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:17.503817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867fa42-ba77-44af-b697-7cbf15b90e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:17.525276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1867fa42-ba77-44af-b697-7cbf15b90e3a None None] MFA Rules not processed for user `71e75366f8b44eb1a0af9d7f8498c7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:17.526805 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1867fa42-ba77-44af-b697-7cbf15b90e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:17.584068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 929/1864] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:24.492599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=25 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:27.576946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=25 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:46.193477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6176c4-73d1-4f94-b84a-c835a9782c89 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:46.193941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6176c4-73d1-4f94-b84a-c835a9782c89 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:46.194198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6176c4-73d1-4f94-b84a-c835a9782c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:46.218935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5f6176c4-73d1-4f94-b84a-c835a9782c89 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:46.220123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5f6176c4-73d1-4f94-b84a-c835a9782c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:46.297053 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 936/1865] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:46.326715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867fa42-ba77-44af-b697-7cbf15b90e3a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:46.329456 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1867fa42-ba77-44af-b697-7cbf15b90e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:46.430135 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867fa42-ba77-44af-b697-7cbf15b90e3a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:46.436352 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81144bc4-97b3-434a-8432-90f015fa96d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:46.436992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144bc4-97b3-434a-8432-90f015fa96d9 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:46.437272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144bc4-97b3-434a-8432-90f015fa96d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:46.437542 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144bc4-97b3-434a-8432-90f015fa96d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:46.446201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81144bc4-97b3-434a-8432-90f015fa96d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:46.448366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81144bc4-97b3-434a-8432-90f015fa96d9 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:46.464923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 930/1866] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:36:47.414666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6176c4-73d1-4f94-b84a-c835a9782c89 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:47.424268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6176c4-73d1-4f94-b84a-c835a9782c89 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:47.428766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:47.429381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:47.429659 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:47.429932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] PATH_INFO: `/v3/users/25265bdff13a433183fc09a3c9a793fb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:47.431272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25265bdff13a433183fc09a3c9a793fb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:47.433248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:47.479848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25265bdff13a433183fc09a3c9a793fb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:47.480642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25265bdff13a433183fc09a3c9a793fb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:47.487537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25265bdff13a433183fc09a3c9a793fb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:47.495249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25265bdff13a433183fc09a3c9a793fb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:47.496178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25265bdff13a433183fc09a3c9a793fb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:47.514804 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 937/1867] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:36:47 2022] DELETE /identity/v3/users/25265bdff13a433183fc09a3c9a793fb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:47.519302 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a4847-3095-4a1f-96d2-dd4fd38c31c0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:47.519763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a4847-3095-4a1f-96d2-dd4fd38c31c0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:47.519878 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a4847-3095-4a1f-96d2-dd4fd38c31c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:47.538965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-683a4847-3095-4a1f-96d2-dd4fd38c31c0 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:47.540309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-683a4847-3095-4a1f-96d2-dd4fd38c31c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:47.597809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 931/1868] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:47.608022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:47.609451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:47.666827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0953eb-7e4c-4817-84d5-99f86532ab3d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:47.670461 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7b7a5-5b25-4b46-af29-2cc71490194c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:47.671076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7b7a5-5b25-4b46-af29-2cc71490194c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:47.671366 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7b7a5-5b25-4b46-af29-2cc71490194c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:47.671660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7b7a5-5b25-4b46-af29-2cc71490194c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:47.681415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7b7a5-5b25-4b46-af29-2cc71490194c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:47.682814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7b7a5-5b25-4b46-af29-2cc71490194c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:47.692072 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 938/1869] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:36:47.899180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba882f-69de-459b-a046-805dd53c6a77 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:47.899488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba882f-69de-459b-a046-805dd53c6a77 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:47.899782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba882f-69de-459b-a046-805dd53c6a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:47.926076 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-82ba882f-69de-459b-a046-805dd53c6a77 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:47.927401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-82ba882f-69de-459b-a046-805dd53c6a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:47.992575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 932/1870] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:36:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:48.006225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7b7a5-5b25-4b46-af29-2cc71490194c service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:48.008946 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c5e7b7a5-5b25-4b46-af29-2cc71490194c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:48.031171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7b7a5-5b25-4b46-af29-2cc71490194c service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:48.048746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:48.049540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.049704 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.049979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] PATH_INFO: `/v3/projects/06bddd675ea248fab6689843b8154bb3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.051790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=06bddd675ea248fab6689843b8154bb3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:48.054264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:48.056272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba882f-69de-459b-a046-805dd53c6a77 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:48.058173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-82ba882f-69de-459b-a046-805dd53c6a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:48.067241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:48.096796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:48.116445 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06bddd675ea248fab6689843b8154bb3', 'request_id': 'req-774e9e80-7401-49a8-a49a-d599f3a71a9c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:48.123278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06bddd675ea248fab6689843b8154bb3', 'request_id': 'req-774e9e80-7401-49a8-a49a-d599f3a71a9c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:48.130922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06bddd675ea248fab6689843b8154bb3', 'request_id': 'req-774e9e80-7401-49a8-a49a-d599f3a71a9c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:48.141322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba882f-69de-459b-a046-805dd53c6a77 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:48.148257 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] The token cache is being invalidate because project 06bddd675ea248fab6689843b8154bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:36:48.148581 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:48.150311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-774e9e80-7401-49a8-a49a-d599f3a71a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:48.151826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 939/1871] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:36:48 2022] DELETE /identity/v3/projects/06bddd675ea248fab6689843b8154bb3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:48.156561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ecf2c-20ab-4474-b82a-3b7c1be8fbaa None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.156845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ecf2c-20ab-4474-b82a-3b7c1be8fbaa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.157165 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ecf2c-20ab-4474-b82a-3b7c1be8fbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.177408 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0c0ecf2c-20ab-4474-b82a-3b7c1be8fbaa None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:48.178586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0c0ecf2c-20ab-4474-b82a-3b7c1be8fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:48.207895 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bab7a-665b-48e5-a2a2-6c9c78e8c8a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:48.208549 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bab7a-665b-48e5-a2a2-6c9c78e8c8a0 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.209192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bab7a-665b-48e5-a2a2-6c9c78e8c8a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.209297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bab7a-665b-48e5-a2a2-6c9c78e8c8a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.211059 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0f2bab7a-665b-48e5-a2a2-6c9c78e8c8a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:48.238372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 940/1872] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:36:48.247729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3a8f3-d4cd-446e-91a8-a1a91a47a728 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.248016 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3a8f3-d4cd-446e-91a8-a1a91a47a728 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.248290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3a8f3-d4cd-446e-91a8-a1a91a47a728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.266916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0db3a8f3-d4cd-446e-91a8-a1a91a47a728 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:48.268104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0db3a8f3-d4cd-446e-91a8-a1a91a47a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:48.271064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bab7a-665b-48e5-a2a2-6c9c78e8c8a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:48.272712 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bab7a-665b-48e5-a2a2-6c9c78e8c8a0 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:48.276762 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 941/1873] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:36:48.280665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3a8f3-d4cd-446e-91a8-a1a91a47a728 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:48.281844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 933/1874] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:36:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:36:48.290636 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3a8f3-d4cd-446e-91a8-a1a91a47a728 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:48.295310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bde80-8cbc-42a7-ab76-92a6f5acf30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:48.296085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bde80-8cbc-42a7-ab76-92a6f5acf30f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.296221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bde80-8cbc-42a7-ab76-92a6f5acf30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.296541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bde80-8cbc-42a7-ab76-92a6f5acf30f admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.297215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bde80-8cbc-42a7-ab76-92a6f5acf30f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:36:48.297517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bde80-8cbc-42a7-ab76-92a6f5acf30f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:48.299130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bde80-8cbc-42a7-ab76-92a6f5acf30f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:48.312693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 942/1875] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:36:48.318623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bab7a-665b-48e5-a2a2-6c9c78e8c8a0 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:48.329631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bab7a-665b-48e5-a2a2-6c9c78e8c8a0 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:48.334524 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cef3b1-e78a-42f6-a495-b7eadefb9457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:48.334934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef3b1-e78a-42f6-a495-b7eadefb9457 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.335219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef3b1-e78a-42f6-a495-b7eadefb9457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.335492 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef3b1-e78a-42f6-a495-b7eadefb9457 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.336282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cef3b1-e78a-42f6-a495-b7eadefb9457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:48.338511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cef3b1-e78a-42f6-a495-b7eadefb9457 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:48.369199 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 934/1876] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:36:48 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:36:48.373752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bde80-8cbc-42a7-ab76-92a6f5acf30f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:48.387277 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bde80-8cbc-42a7-ab76-92a6f5acf30f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:48.449695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5e1d2-4af5-47dd-a980-2ae039d569b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:48.450320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5e1d2-4af5-47dd-a980-2ae039d569b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.450506 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5e1d2-4af5-47dd-a980-2ae039d569b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.450819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5e1d2-4af5-47dd-a980-2ae039d569b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.451501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5e1d2-4af5-47dd-a980-2ae039d569b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:48.453546 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5e1d2-4af5-47dd-a980-2ae039d569b8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:48.483846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 943/1877] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:36:48 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:36:48.488807 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cef3b1-e78a-42f6-a495-b7eadefb9457 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:48.501121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cef3b1-e78a-42f6-a495-b7eadefb9457 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:48.505908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69378e-e231-4519-89f8-8eafe329cbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:48.506515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69378e-e231-4519-89f8-8eafe329cbce admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.506792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69378e-e231-4519-89f8-8eafe329cbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.507063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69378e-e231-4519-89f8-8eafe329cbce admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.507699 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69378e-e231-4519-89f8-8eafe329cbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:48.509988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69378e-e231-4519-89f8-8eafe329cbce admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:48.526615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 935/1878] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:36:48.527803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5e1d2-4af5-47dd-a980-2ae039d569b8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:48.538623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5e1d2-4af5-47dd-a980-2ae039d569b8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:48.544112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fc850-5152-4d6b-bae4-d370ccefc478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:48.544755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fc850-5152-4d6b-bae4-d370ccefc478 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.545151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fc850-5152-4d6b-bae4-d370ccefc478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.545338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fc850-5152-4d6b-bae4-d370ccefc478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.545946 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fc850-5152-4d6b-bae4-d370ccefc478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:48.547538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fc850-5152-4d6b-bae4-d370ccefc478 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:48.550555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:48.564521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 944/1879] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:36:48.568725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69378e-e231-4519-89f8-8eafe329cbce admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:48.580738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69378e-e231-4519-89f8-8eafe329cbce admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:48.586176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0c402-e54a-4833-b6e9-c1dba431012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:48.587373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0c402-e54a-4833-b6e9-c1dba431012d admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.588014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0c402-e54a-4833-b6e9-c1dba431012d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.588413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0c402-e54a-4833-b6e9-c1dba431012d admin admin] PATH_INFO: `/v3/projects/bdfc0df85a244e7fa8ec80953dada8b6/users/f4b1f10c610047408bb2271f15ed4bbd/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.611455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0c402-e54a-4833-b6e9-c1dba431012d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfc0df85a244e7fa8ec80953dada8b6, user_id=f4b1f10c610047408bb2271f15ed4bbd, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:48.614689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0c402-e54a-4833-b6e9-c1dba431012d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:48.630446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 936/1880] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:36:48 2022] PUT /identity/v3/projects/bdfc0df85a244e7fa8ec80953dada8b6/users/f4b1f10c610047408bb2271f15ed4bbd/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:48.650758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff94d2-ebd2-4f79-82b9-3d4315557ab1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.650758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff94d2-ebd2-4f79-82b9-3d4315557ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.650758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff94d2-ebd2-4f79-82b9-3d4315557ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.694585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-23ff94d2-ebd2-4f79-82b9-3d4315557ab1 None None] MFA Rules not processed for user `f4b1f10c610047408bb2271f15ed4bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:48.696087 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-23ff94d2-ebd2-4f79-82b9-3d4315557ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:48.781389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 945/1881] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:48.790211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0c402-e54a-4833-b6e9-c1dba431012d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:48.792537 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-82c0c402-e54a-4833-b6e9-c1dba431012d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:48.823930 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:48.875361 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0c402-e54a-4833-b6e9-c1dba431012d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:48.883221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257b9c8-9ab1-4b09-b9d6-caa044d6ecb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:48.884519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257b9c8-9ab1-4b09-b9d6-caa044d6ecb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:48.884811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257b9c8-9ab1-4b09-b9d6-caa044d6ecb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:48.885083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257b9c8-9ab1-4b09-b9d6-caa044d6ecb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:48.894167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257b9c8-9ab1-4b09-b9d6-caa044d6ecb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:48.895685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257b9c8-9ab1-4b09-b9d6-caa044d6ecb4 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:48.905941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 937/1882] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:36:48 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:36:51.477892 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc5ba-385c-4791-8681-86d134f566c3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:51.478409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc5ba-385c-4791-8681-86d134f566c3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:51.478409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc5ba-385c-4791-8681-86d134f566c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:51.507375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1f6bc5ba-385c-4791-8681-86d134f566c3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:51.511426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1f6bc5ba-385c-4791-8681-86d134f566c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:51.584168 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 946/1883] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:51.615515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257b9c8-9ab1-4b09-b9d6-caa044d6ecb4 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:51.628761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d257b9c8-9ab1-4b09-b9d6-caa044d6ecb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:51.709449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257b9c8-9ab1-4b09-b9d6-caa044d6ecb4 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:51.715063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689d843-63b2-400c-a4e6-46e6d30a4820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:51.715671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689d843-63b2-400c-a4e6-46e6d30a4820 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:51.715948 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689d843-63b2-400c-a4e6-46e6d30a4820 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:51.716216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689d843-63b2-400c-a4e6-46e6d30a4820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:51.724370 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689d843-63b2-400c-a4e6-46e6d30a4820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:51.726009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689d843-63b2-400c-a4e6-46e6d30a4820 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:51.736208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 938/1884] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:36:54.171284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bc5ba-385c-4791-8681-86d134f566c3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:54.181939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bc5ba-385c-4791-8681-86d134f566c3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:54.187360 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:54.187999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:54.188272 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:54.188877 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] PATH_INFO: `/v3/users/f4b1f10c610047408bb2271f15ed4bbd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:54.190038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b1f10c610047408bb2271f15ed4bbd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:54.191947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:54.249360 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b1f10c610047408bb2271f15ed4bbd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:54.249705 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b1f10c610047408bb2271f15ed4bbd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:54.261886 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b1f10c610047408bb2271f15ed4bbd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:54.275327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b1f10c610047408bb2271f15ed4bbd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:54.276145 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b1f10c610047408bb2271f15ed4bbd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:54.295533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:54.304036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 947/1885] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:36:54 2022] DELETE /identity/v3/users/f4b1f10c610047408bb2271f15ed4bbd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:54.306356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399559b8-689e-4c7b-bf99-214364d7dbc6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:54.306895 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399559b8-689e-4c7b-bf99-214364d7dbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:54.307001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399559b8-689e-4c7b-bf99-214364d7dbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:54.355560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-399559b8-689e-4c7b-bf99-214364d7dbc6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:54.356841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-399559b8-689e-4c7b-bf99-214364d7dbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:54.491902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 939/1886] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:54.499201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:54.500885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:54.569635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816399f-14bf-4eb3-b0ee-7f384b59cde7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:54.574357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e9105-1c2d-4f15-acce-44a5199f38bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:54.574973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e9105-1c2d-4f15-acce-44a5199f38bb service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:54.575256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e9105-1c2d-4f15-acce-44a5199f38bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:54.575532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e9105-1c2d-4f15-acce-44a5199f38bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:54.585090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e9105-1c2d-4f15-acce-44a5199f38bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:54.587055 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e9105-1c2d-4f15-acce-44a5199f38bb service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:54.596479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 948/1887] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:36:54.874806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399559b8-689e-4c7b-bf99-214364d7dbc6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:54.876636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-399559b8-689e-4c7b-bf99-214364d7dbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:54.906276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399559b8-689e-4c7b-bf99-214364d7dbc6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:54.920787 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:54.921475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:54.921757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:54.922025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] PATH_INFO: `/v3/projects/bdfc0df85a244e7fa8ec80953dada8b6` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:54.923145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfc0df85a244e7fa8ec80953dada8b6)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:54.925391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:54.980954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:36:54.993592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfc0df85a244e7fa8ec80953dada8b6', 'request_id': 'req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:55.003099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfc0df85a244e7fa8ec80953dada8b6', 'request_id': 'req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:55.020316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfc0df85a244e7fa8ec80953dada8b6', 'request_id': 'req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:55.035466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] The token cache is being invalidate because project bdfc0df85a244e7fa8ec80953dada8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:36:55.035770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:55.036410 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:36:55.038918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 940/1888] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:36:54 2022] DELETE /identity/v3/projects/bdfc0df85a244e7fa8ec80953dada8b6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:36:57.004172 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeefb4-ed65-4c00-ba23-4677402bd786 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:57.004722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeefb4-ed65-4c00-ba23-4677402bd786 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:57.004882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeefb4-ed65-4c00-ba23-4677402bd786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:57.041303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1aeeefb4-ed65-4c00-ba23-4677402bd786 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:57.042644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1aeeefb4-ed65-4c00-ba23-4677402bd786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:57.156751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 949/1889] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:36:57.189221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:36:57.191573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:57.364078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a2dcc-5494-42a6-87d4-606f0fd5b89c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:36:57.371387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9f5e-0a60-4be6-8f9c-b3c2fd94c2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:36:57.372146 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9f5e-0a60-4be6-8f9c-b3c2fd94c2bb service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:57.372398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9f5e-0a60-4be6-8f9c-b3c2fd94c2bb service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:57.372839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9f5e-0a60-4be6-8f9c-b3c2fd94c2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:57.383757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d9f5e-0a60-4be6-8f9c-b3c2fd94c2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:36:57.385683 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d9f5e-0a60-4be6-8f9c-b3c2fd94c2bb service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:36:57.397931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 941/1890] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:36:59.140680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2a2e0-97c3-4b4f-9693-af1089928ec1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:36:59.141233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2a2e0-97c3-4b4f-9693-af1089928ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:36:59.141233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2a2e0-97c3-4b4f-9693-af1089928ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:36:59.162135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c0e2a2e0-97c3-4b4f-9693-af1089928ec1 None None] MFA Rules not processed for user `e0281fe66a8047f7ae0d8d7d48dc8470`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:36:59.163693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c0e2a2e0-97c3-4b4f-9693-af1089928ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:36:59.234000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 950/1891] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:36:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:00.887390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9f5e-0a60-4be6-8f9c-b3c2fd94c2bb service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:00.889529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5c3d9f5e-0a60-4be6-8f9c-b3c2fd94c2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:01.025944 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9f5e-0a60-4be6-8f9c-b3c2fd94c2bb service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:01.031443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d57007-56c7-492c-a030-e9ec8434685d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:01.032069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d57007-56c7-492c-a030-e9ec8434685d service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:01.032348 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d57007-56c7-492c-a030-e9ec8434685d service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:01.032667 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d57007-56c7-492c-a030-e9ec8434685d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:01.034429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-79d57007-56c7-492c-a030-e9ec8434685d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:01.049038 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d57007-56c7-492c-a030-e9ec8434685d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:01.050499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d57007-56c7-492c-a030-e9ec8434685d service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:01.064624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 942/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:02.142471 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f6094-9ac9-4021-9cbd-281f77a02daa None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:02.143037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f6094-9ac9-4021-9cbd-281f77a02daa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:02.143037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f6094-9ac9-4021-9cbd-281f77a02daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:02.185775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f46f6094-9ac9-4021-9cbd-281f77a02daa None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:02.187110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f46f6094-9ac9-4021-9cbd-281f77a02daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:02.198965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 951/1893] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:02.222036 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d57007-56c7-492c-a030-e9ec8434685d service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:02.247035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d57007-56c7-492c-a030-e9ec8434685d service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:02.255554 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5446a3-a500-4b6f-9dc3-3fb6e4e2eb28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:02.256598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5446a3-a500-4b6f-9dc3-3fb6e4e2eb28 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:02.256806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5446a3-a500-4b6f-9dc3-3fb6e4e2eb28 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:02.257512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5446a3-a500-4b6f-9dc3-3fb6e4e2eb28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:02.275041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5446a3-a500-4b6f-9dc3-3fb6e4e2eb28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:02.277230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5446a3-a500-4b6f-9dc3-3fb6e4e2eb28 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:02.291991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 943/1894] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:07.459704 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db308a7-85cf-43ca-81a7-3c6916315ba2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:07.460216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db308a7-85cf-43ca-81a7-3c6916315ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:07.460330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db308a7-85cf-43ca-81a7-3c6916315ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:07.482329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7db308a7-85cf-43ca-81a7-3c6916315ba2 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:07.483613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7db308a7-85cf-43ca-81a7-3c6916315ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:07.494268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 952/1895] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:07.518136 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5446a3-a500-4b6f-9dc3-3fb6e4e2eb28 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:07.519753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ee5446a3-a500-4b6f-9dc3-3fb6e4e2eb28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:07.534824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5446a3-a500-4b6f-9dc3-3fb6e4e2eb28 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:07.540666 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49945d3-fa04-42a0-83ea-7713c5199455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:07.541307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49945d3-fa04-42a0-83ea-7713c5199455 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:07.541577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49945d3-fa04-42a0-83ea-7713c5199455 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:07.541882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49945d3-fa04-42a0-83ea-7713c5199455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:07.550570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49945d3-fa04-42a0-83ea-7713c5199455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:07.552136 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49945d3-fa04-42a0-83ea-7713c5199455 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:07.562488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 944/1896] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:08.635011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd7f6-2310-4386-ad0f-6c4a73b9e129 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:08.635477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd7f6-2310-4386-ad0f-6c4a73b9e129 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:08.635585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd7f6-2310-4386-ad0f-6c4a73b9e129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:08.654752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f10bd7f6-2310-4386-ad0f-6c4a73b9e129 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:08.656014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f10bd7f6-2310-4386-ad0f-6c4a73b9e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:08.685113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:08.710210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 953/1897] 10.222.0.20 () {58 vars in 967 bytes} [Wed Nov 2 03:37:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:08.723003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49945d3-fa04-42a0-83ea-7713c5199455 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:08.724383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a49945d3-fa04-42a0-83ea-7713c5199455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:08.744759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:08.794949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49945d3-fa04-42a0-83ea-7713c5199455 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:08.800695 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca93f89-405e-420d-9010-3628363e5950 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:08.801330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93f89-405e-420d-9010-3628363e5950 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:08.801606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93f89-405e-420d-9010-3628363e5950 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:08.801883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93f89-405e-420d-9010-3628363e5950 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:08.811094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca93f89-405e-420d-9010-3628363e5950 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:08.812725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca93f89-405e-420d-9010-3628363e5950 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:08.821996 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 945/1898] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:37:11.179556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bd7f6-2310-4386-ad0f-6c4a73b9e129 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:11.182180 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f10bd7f6-2310-4386-ad0f-6c4a73b9e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:11.197825 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bd7f6-2310-4386-ad0f-6c4a73b9e129 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:11.203662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:11.204436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:11.204763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:11.205061 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] PATH_INFO: `/v3/users/b69a114040224ea7a7d21ace8f074bc3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:11.206215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69a114040224ea7a7d21ace8f074bc3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:11.208193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:11.264855 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69a114040224ea7a7d21ace8f074bc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:11.265533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69a114040224ea7a7d21ace8f074bc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:11.277094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69a114040224ea7a7d21ace8f074bc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:11.291239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69a114040224ea7a7d21ace8f074bc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:11.291930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-081905d2-28c3-436e-8bfe-98928dffa5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69a114040224ea7a7d21ace8f074bc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:11.327695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 954/1899] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:37:11 2022] DELETE /identity/v3/users/b69a114040224ea7a7d21ace8f074bc3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:37:11.517799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca93f89-405e-420d-9010-3628363e5950 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:11.545444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca93f89-405e-420d-9010-3628363e5950 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:11.612224 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:11.612900 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:11.613176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:11.613445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] PATH_INFO: `/v3/projects/325aba3c469a456fb9c19eb51bab685a` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:11.614555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=325aba3c469a456fb9c19eb51bab685a)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:11.616489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:11.667937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325aba3c469a456fb9c19eb51bab685a', 'request_id': 'req-f74cf295-ff7d-4498-9e54-0e2e613999e3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:11.676232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325aba3c469a456fb9c19eb51bab685a', 'request_id': 'req-f74cf295-ff7d-4498-9e54-0e2e613999e3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:11.681847 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325aba3c469a456fb9c19eb51bab685a', 'request_id': 'req-f74cf295-ff7d-4498-9e54-0e2e613999e3'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:11.693038 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] The token cache is being invalidate because project 325aba3c469a456fb9c19eb51bab685a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:37:11.693328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:11.693958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-f74cf295-ff7d-4498-9e54-0e2e613999e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:11.695641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 946/1900] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:37:11 2022] DELETE /identity/v3/projects/325aba3c469a456fb9c19eb51bab685a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:37:11.700482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb469-cbfe-41f3-b281-f2ec63bbcce2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:11.700789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb469-cbfe-41f3-b281-f2ec63bbcce2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:11.701068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb469-cbfe-41f3-b281-f2ec63bbcce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:11.720826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-656bb469-cbfe-41f3-b281-f2ec63bbcce2 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:11.722024 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-656bb469-cbfe-41f3-b281-f2ec63bbcce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:11.780270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 955/1901] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:11.788635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922569c-d5a9-41ad-becc-5af7fa2bfc3b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:11.789448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922569c-d5a9-41ad-becc-5af7fa2bfc3b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:11.789726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922569c-d5a9-41ad-becc-5af7fa2bfc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:11.812054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3922569c-d5a9-41ad-becc-5af7fa2bfc3b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:11.813309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3922569c-d5a9-41ad-becc-5af7fa2bfc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:11.821802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 947/1902] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:11.826024 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb469-cbfe-41f3-b281-f2ec63bbcce2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:11.836031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb469-cbfe-41f3-b281-f2ec63bbcce2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:11.840608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27092-7ccc-4878-b7f6-8df76d852144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:11.841201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27092-7ccc-4878-b7f6-8df76d852144 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:11.841484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27092-7ccc-4878-b7f6-8df76d852144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:11.841758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27092-7ccc-4878-b7f6-8df76d852144 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:11.842403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27092-7ccc-4878-b7f6-8df76d852144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:37:11.842708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27092-7ccc-4878-b7f6-8df76d852144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:11.844275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27092-7ccc-4878-b7f6-8df76d852144 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:11.857035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 956/1903] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:37:11.861860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922569c-d5a9-41ad-becc-5af7fa2bfc3b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:11.871134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922569c-d5a9-41ad-becc-5af7fa2bfc3b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:11.875793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97c7f6-73a4-4719-8d99-f979583ebabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:11.876394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97c7f6-73a4-4719-8d99-f979583ebabd admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:11.876717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97c7f6-73a4-4719-8d99-f979583ebabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:11.877021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97c7f6-73a4-4719-8d99-f979583ebabd admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:11.877704 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97c7f6-73a4-4719-8d99-f979583ebabd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:11.879604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97c7f6-73a4-4719-8d99-f979583ebabd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:11.907749 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 948/1904] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:37:11 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:37:11.966556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27092-7ccc-4878-b7f6-8df76d852144 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:11.977066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27092-7ccc-4878-b7f6-8df76d852144 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:12.014316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:12.037609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf65ebf-d87e-4e7c-9630-a3a31d413999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:12.038253 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf65ebf-d87e-4e7c-9630-a3a31d413999 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:12.038552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf65ebf-d87e-4e7c-9630-a3a31d413999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:12.043943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf65ebf-d87e-4e7c-9630-a3a31d413999 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:12.043943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf65ebf-d87e-4e7c-9630-a3a31d413999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:12.043943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf65ebf-d87e-4e7c-9630-a3a31d413999 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:12.065501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 957/1905] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:37:11 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:37:12.069636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97c7f6-73a4-4719-8d99-f979583ebabd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:12.081562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97c7f6-73a4-4719-8d99-f979583ebabd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:12.086868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847596d-a083-4091-bd58-fa36c9afb0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:12.088067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847596d-a083-4091-bd58-fa36c9afb0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:12.088351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847596d-a083-4091-bd58-fa36c9afb0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:12.088670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847596d-a083-4091-bd58-fa36c9afb0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:12.089295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847596d-a083-4091-bd58-fa36c9afb0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:12.090895 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847596d-a083-4091-bd58-fa36c9afb0f8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:12.093434 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:12.106030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 949/1906] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:37:12.110156 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf65ebf-d87e-4e7c-9630-a3a31d413999 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:12.133890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf65ebf-d87e-4e7c-9630-a3a31d413999 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:12.139225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e292d-c741-48af-9b17-22822af917bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:12.139843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e292d-c741-48af-9b17-22822af917bb admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:12.140248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e292d-c741-48af-9b17-22822af917bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:12.140568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e292d-c741-48af-9b17-22822af917bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:12.141220 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e292d-c741-48af-9b17-22822af917bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:12.142806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e292d-c741-48af-9b17-22822af917bb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:12.153706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 958/1907] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:37:12.157994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847596d-a083-4091-bd58-fa36c9afb0f8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:12.168111 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847596d-a083-4091-bd58-fa36c9afb0f8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:12.172844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aad167-ee81-4b8d-bc69-3117b14b0e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:12.173511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aad167-ee81-4b8d-bc69-3117b14b0e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:12.173792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aad167-ee81-4b8d-bc69-3117b14b0e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:12.174054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aad167-ee81-4b8d-bc69-3117b14b0e7c admin admin] PATH_INFO: `/v3/projects/3f5281c25fbd497a9c86916687049801/users/d52eb54c44be448e9eea9e7290931b81/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:12.188389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aad167-ee81-4b8d-bc69-3117b14b0e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5281c25fbd497a9c86916687049801, user_id=d52eb54c44be448e9eea9e7290931b81, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:12.191045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aad167-ee81-4b8d-bc69-3117b14b0e7c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:12.204202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 950/1908] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:37:12 2022] PUT /identity/v3/projects/3f5281c25fbd497a9c86916687049801/users/d52eb54c44be448e9eea9e7290931b81/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:37:12.214825 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbdde0-af76-4740-aa16-9f61a46499cc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:12.215351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbdde0-af76-4740-aa16-9f61a46499cc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:12.215465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbdde0-af76-4740-aa16-9f61a46499cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:12.243460 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-91bbdde0-af76-4740-aa16-9f61a46499cc None None] MFA Rules not processed for user `d52eb54c44be448e9eea9e7290931b81`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:12.244716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-91bbdde0-af76-4740-aa16-9f61a46499cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:12.309079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 959/1909] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:12.319634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aad167-ee81-4b8d-bc69-3117b14b0e7c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:12.322485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-49aad167-ee81-4b8d-bc69-3117b14b0e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:12.400340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aad167-ee81-4b8d-bc69-3117b14b0e7c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:12.403990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6dd73-5b30-4279-a8d1-eb52847660a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:12.404664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6dd73-5b30-4279-a8d1-eb52847660a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:12.404945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6dd73-5b30-4279-a8d1-eb52847660a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:12.405216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6dd73-5b30-4279-a8d1-eb52847660a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:12.415130 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6dd73-5b30-4279-a8d1-eb52847660a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:12.416523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6dd73-5b30-4279-a8d1-eb52847660a9 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:12.425520 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 951/1910] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:13.797596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a57aeb-0720-44ba-aa18-b8732eabb694 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:13.798539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a57aeb-0720-44ba-aa18-b8732eabb694 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:13.799138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a57aeb-0720-44ba-aa18-b8732eabb694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:13.831420 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c9a57aeb-0720-44ba-aa18-b8732eabb694 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:13.832671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c9a57aeb-0720-44ba-aa18-b8732eabb694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:13.893708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 960/1911] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:13.920177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6dd73-5b30-4279-a8d1-eb52847660a9 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:13.921900 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8bf6dd73-5b30-4279-a8d1-eb52847660a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:14.012372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6dd73-5b30-4279-a8d1-eb52847660a9 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:14.017890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612ec3c-8ae9-4da3-b363-53c5a85a91b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:14.018501 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612ec3c-8ae9-4da3-b363-53c5a85a91b5 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:14.018782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612ec3c-8ae9-4da3-b363-53c5a85a91b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:14.019054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612ec3c-8ae9-4da3-b363-53c5a85a91b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:14.027689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612ec3c-8ae9-4da3-b363-53c5a85a91b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:14.029295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612ec3c-8ae9-4da3-b363-53c5a85a91b5 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:14.040510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 952/1912] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:22.717061 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a57aeb-0720-44ba-aa18-b8732eabb694 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:22.728627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a57aeb-0720-44ba-aa18-b8732eabb694 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:22.733749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:22.734710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:22.734997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:22.735274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] PATH_INFO: `/v3/users/d52eb54c44be448e9eea9e7290931b81` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:22.736736 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d52eb54c44be448e9eea9e7290931b81)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:22.738698 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:22.796152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:22.798227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd52eb54c44be448e9eea9e7290931b81'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:22.799253 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd52eb54c44be448e9eea9e7290931b81'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:22.811740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd52eb54c44be448e9eea9e7290931b81'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:22.821607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd52eb54c44be448e9eea9e7290931b81'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:22.822580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd52eb54c44be448e9eea9e7290931b81'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:22.849789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 961/1913] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:37:22 2022] DELETE /identity/v3/users/d52eb54c44be448e9eea9e7290931b81 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:37:22.854953 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975ece1-9ed0-4553-982d-ad066e50151a None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:22.855469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975ece1-9ed0-4553-982d-ad066e50151a None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:22.855598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975ece1-9ed0-4553-982d-ad066e50151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:22.876662 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b975ece1-9ed0-4553-982d-ad066e50151a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:22.877864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b975ece1-9ed0-4553-982d-ad066e50151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:22.938703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 953/1914] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:22.948833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:22.950261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:23.006897 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f83ab-df80-42ca-ba79-ef3f97837d74 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:23.011303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a407c-b85d-44ea-97e5-ca859052388a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:23.011893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a407c-b85d-44ea-97e5-ca859052388a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.012193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a407c-b85d-44ea-97e5-ca859052388a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.012447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a407c-b85d-44ea-97e5-ca859052388a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.021250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a407c-b85d-44ea-97e5-ca859052388a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:23.022653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a407c-b85d-44ea-97e5-ca859052388a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:23.032157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 962/1915] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:23.304179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975ece1-9ed0-4553-982d-ad066e50151a None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:23.306719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b975ece1-9ed0-4553-982d-ad066e50151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:23.313841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:23.320374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975ece1-9ed0-4553-982d-ad066e50151a None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:23.326260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:23.327178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.327554 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.327812 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] PATH_INFO: `/v3/projects/3f5281c25fbd497a9c86916687049801` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.329031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5281c25fbd497a9c86916687049801)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:23.330933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:23.380863 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5281c25fbd497a9c86916687049801', 'request_id': 'req-67d0d641-9d86-4213-adcc-37de09d30b8a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:23.388688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5281c25fbd497a9c86916687049801', 'request_id': 'req-67d0d641-9d86-4213-adcc-37de09d30b8a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:23.394197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5281c25fbd497a9c86916687049801', 'request_id': 'req-67d0d641-9d86-4213-adcc-37de09d30b8a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:23.405397 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] The token cache is being invalidate because project 3f5281c25fbd497a9c86916687049801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:37:23.405680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:23.406329 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-67d0d641-9d86-4213-adcc-37de09d30b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:37:23.407812 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 954/1916] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:37:23 2022] DELETE /identity/v3/projects/3f5281c25fbd497a9c86916687049801 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:37:23.412678 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cb873-86ac-4d42-85e4-6f3d544c6332 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.412990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cb873-86ac-4d42-85e4-6f3d544c6332 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.413266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cb873-86ac-4d42-85e4-6f3d544c6332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.433813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b69cb873-86ac-4d42-85e4-6f3d544c6332 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:23.435019 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b69cb873-86ac-4d42-85e4-6f3d544c6332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:23.493190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 963/1917] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:23.501099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2604-a0f4-4048-8687-0354f50a28ec None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.501387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2604-a0f4-4048-8687-0354f50a28ec None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.501662 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2604-a0f4-4048-8687-0354f50a28ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.521128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-096e2604-a0f4-4048-8687-0354f50a28ec None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:23.522326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-096e2604-a0f4-4048-8687-0354f50a28ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:23.530614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 955/1918] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:23.534768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cb873-86ac-4d42-85e4-6f3d544c6332 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:23.545025 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cb873-86ac-4d42-85e4-6f3d544c6332 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:23.549631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13d446-198f-4740-b511-c059abc97666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:23.550166 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13d446-198f-4740-b511-c059abc97666 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.550449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13d446-198f-4740-b511-c059abc97666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.550719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13d446-198f-4740-b511-c059abc97666 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.551355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13d446-198f-4740-b511-c059abc97666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:37:23.551658 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13d446-198f-4740-b511-c059abc97666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:23.553281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13d446-198f-4740-b511-c059abc97666 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:23.564600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 964/1919] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:37:23.568690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e2604-a0f4-4048-8687-0354f50a28ec None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:23.578573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e2604-a0f4-4048-8687-0354f50a28ec None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:23.583295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f53647-84c7-4cbf-9440-34bf87644df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:23.583890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f53647-84c7-4cbf-9440-34bf87644df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.584179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f53647-84c7-4cbf-9440-34bf87644df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.584450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f53647-84c7-4cbf-9440-34bf87644df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.585138 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f53647-84c7-4cbf-9440-34bf87644df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:23.587554 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f53647-84c7-4cbf-9440-34bf87644df6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:23.620234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 956/1920] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:37:23 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:37:23.621327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13d446-198f-4740-b511-c059abc97666 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:23.631496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13d446-198f-4740-b511-c059abc97666 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:23.679883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:23.691393 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295815f9-a6f5-44f8-b3d2-2469bbd8634a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:23.692173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295815f9-a6f5-44f8-b3d2-2469bbd8634a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.692661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295815f9-a6f5-44f8-b3d2-2469bbd8634a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.693028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295815f9-a6f5-44f8-b3d2-2469bbd8634a admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.693966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295815f9-a6f5-44f8-b3d2-2469bbd8634a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:23.696215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295815f9-a6f5-44f8-b3d2-2469bbd8634a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:23.717971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 965/1921] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:37:23 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:37:23.723536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f53647-84c7-4cbf-9440-34bf87644df6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:23.735276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f53647-84c7-4cbf-9440-34bf87644df6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:23.740273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1296b-bead-407b-8432-aaa3a5f98329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:23.740912 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1296b-bead-407b-8432-aaa3a5f98329 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.741201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1296b-bead-407b-8432-aaa3a5f98329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.741474 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1296b-bead-407b-8432-aaa3a5f98329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.742116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1296b-bead-407b-8432-aaa3a5f98329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:23.744328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1296b-bead-407b-8432-aaa3a5f98329 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:23.755686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 957/1922] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:37:23.759571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295815f9-a6f5-44f8-b3d2-2469bbd8634a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:23.769713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295815f9-a6f5-44f8-b3d2-2469bbd8634a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:23.775912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbea31f-69ad-45ae-baf0-4a9cb42e52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:23.776563 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbea31f-69ad-45ae-baf0-4a9cb42e52c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.776849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbea31f-69ad-45ae-baf0-4a9cb42e52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.777127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbea31f-69ad-45ae-baf0-4a9cb42e52c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.777771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbea31f-69ad-45ae-baf0-4a9cb42e52c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:23.779477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbea31f-69ad-45ae-baf0-4a9cb42e52c1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:23.791911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 966/1923] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:37:23.796033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1296b-bead-407b-8432-aaa3a5f98329 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:23.807392 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1296b-bead-407b-8432-aaa3a5f98329 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:23.811964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d33db6-803c-4e17-86ff-f425917f9f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:23.812656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d33db6-803c-4e17-86ff-f425917f9f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.812944 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d33db6-803c-4e17-86ff-f425917f9f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.813221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d33db6-803c-4e17-86ff-f425917f9f55 admin admin] PATH_INFO: `/v3/projects/df51db5ecf9e4077a162f638d7f4511e/users/d743ca42c0ff416098c79749a0e3e3bf/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.828110 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d33db6-803c-4e17-86ff-f425917f9f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df51db5ecf9e4077a162f638d7f4511e, user_id=d743ca42c0ff416098c79749a0e3e3bf, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:23.830790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d33db6-803c-4e17-86ff-f425917f9f55 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:23.844423 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 958/1924] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:37:23 2022] PUT /identity/v3/projects/df51db5ecf9e4077a162f638d7f4511e/users/d743ca42c0ff416098c79749a0e3e3bf/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:37:23.849522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650f541-d38b-4048-b078-a72afbecfa73 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:23.849813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650f541-d38b-4048-b078-a72afbecfa73 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:23.850091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650f541-d38b-4048-b078-a72afbecfa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:23.869882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2650f541-d38b-4048-b078-a72afbecfa73 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:23.871075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2650f541-d38b-4048-b078-a72afbecfa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:23.929093 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 967/1925] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:23.938657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d33db6-803c-4e17-86ff-f425917f9f55 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:23.940379 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-37d33db6-803c-4e17-86ff-f425917f9f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:23.998296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d33db6-803c-4e17-86ff-f425917f9f55 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:24.001961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff601-9ba3-44b6-a16d-4a5e37529ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:24.002576 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff601-9ba3-44b6-a16d-4a5e37529ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:24.002856 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff601-9ba3-44b6-a16d-4a5e37529ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:24.003128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff601-9ba3-44b6-a16d-4a5e37529ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:24.013066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff601-9ba3-44b6-a16d-4a5e37529ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:24.014495 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff601-9ba3-44b6-a16d-4a5e37529ff4 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:24.024995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 959/1926] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:28.750567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59313fea-ce2f-4c7b-8696-f550a4dbf5b6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:28.751686 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59313fea-ce2f-4c7b-8696-f550a4dbf5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:28.752242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59313fea-ce2f-4c7b-8696-f550a4dbf5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:28.828554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-59313fea-ce2f-4c7b-8696-f550a4dbf5b6 None None] MFA Rules not processed for user `d743ca42c0ff416098c79749a0e3e3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:28.832335 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-59313fea-ce2f-4c7b-8696-f550a4dbf5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:28.908013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e7ee4-ed14-4681-8406-55309e7ec4e5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:28.908687 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e7ee4-ed14-4681-8406-55309e7ec4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:28.908687 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e7ee4-ed14-4681-8406-55309e7ec4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:28.942368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3c1e7ee4-ed14-4681-8406-55309e7ec4e5 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:28.944148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3c1e7ee4-ed14-4681-8406-55309e7ec4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:28.987925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:29.029513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 968/1927] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:29.034515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59313fea-ce2f-4c7b-8696-f550a4dbf5b6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:29.050397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59313fea-ce2f-4c7b-8696-f550a4dbf5b6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:29.056451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186c2cb-59b4-4319-ac3d-b8390e3fa3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:29.057708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186c2cb-59b4-4319-ac3d-b8390e3fa3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:29.058003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186c2cb-59b4-4319-ac3d-b8390e3fa3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:29.058286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186c2cb-59b4-4319-ac3d-b8390e3fa3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:29.058522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 960/1928] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:37:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:37:29.062926 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186c2cb-59b4-4319-ac3d-b8390e3fa3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:29.065283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186c2cb-59b4-4319-ac3d-b8390e3fa3f1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:29.073316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e7ee4-ed14-4681-8406-55309e7ec4e5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:29.075631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3c1e7ee4-ed14-4681-8406-55309e7ec4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:29.123498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 969/1929] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:37:29 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:37:29.124648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186c2cb-59b4-4319-ac3d-b8390e3fa3f1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:29.187897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e7ee4-ed14-4681-8406-55309e7ec4e5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:29.218136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:29.260809 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186c2cb-59b4-4319-ac3d-b8390e3fa3f1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:29.267897 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d5a85-ed55-4ccb-b4e0-e2aefe65b22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:29.269260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d5a85-ed55-4ccb-b4e0-e2aefe65b22e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:29.269607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d5a85-ed55-4ccb-b4e0-e2aefe65b22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:29.269945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d5a85-ed55-4ccb-b4e0-e2aefe65b22e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:29.270642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d5a85-ed55-4ccb-b4e0-e2aefe65b22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:29.274279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d5a85-ed55-4ccb-b4e0-e2aefe65b22e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:29.294330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e737f18-65ca-46b7-bed2-793ad3184480 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:29.295067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e737f18-65ca-46b7-bed2-793ad3184480 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:29.295424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e737f18-65ca-46b7-bed2-793ad3184480 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:29.295932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e737f18-65ca-46b7-bed2-793ad3184480 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:29.301845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 970/1930] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:37:29 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:37:29.302940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d5a85-ed55-4ccb-b4e0-e2aefe65b22e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:29.315033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d5a85-ed55-4ccb-b4e0-e2aefe65b22e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:29.321493 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38463e4-5bc0-40c7-860b-40268592428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:29.322333 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38463e4-5bc0-40c7-860b-40268592428f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:29.322768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38463e4-5bc0-40c7-860b-40268592428f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:29.323277 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38463e4-5bc0-40c7-860b-40268592428f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:29.324023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38463e4-5bc0-40c7-860b-40268592428f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:29.325814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38463e4-5bc0-40c7-860b-40268592428f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:29.342419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 971/1931] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:37:29.343931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38463e4-5bc0-40c7-860b-40268592428f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:29.356139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38463e4-5bc0-40c7-860b-40268592428f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:29.362424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86120477-b4fa-465c-874d-9e9a21c2afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:29.362974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e737f18-65ca-46b7-bed2-793ad3184480 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:29.363221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86120477-b4fa-465c-874d-9e9a21c2afbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:29.363638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86120477-b4fa-465c-874d-9e9a21c2afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:29.363917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86120477-b4fa-465c-874d-9e9a21c2afbf admin admin] PATH_INFO: `/v3/projects/10001015666b479e933be8b35d3e85d5/users/15eb554599ab4833b4559e6e03107c32/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:29.364623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e737f18-65ca-46b7-bed2-793ad3184480 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:29.373904 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 961/1932] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:37:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 03:37:29.387532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86120477-b4fa-465c-874d-9e9a21c2afbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=10001015666b479e933be8b35d3e85d5, user_id=15eb554599ab4833b4559e6e03107c32, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:29.391147 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86120477-b4fa-465c-874d-9e9a21c2afbf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:29.409217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 972/1933] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:37:29 2022] PUT /identity/v3/projects/10001015666b479e933be8b35d3e85d5/users/15eb554599ab4833b4559e6e03107c32/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:37:29.412924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e737f18-65ca-46b7-bed2-793ad3184480 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:29.426917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e737f18-65ca-46b7-bed2-793ad3184480 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:29.439387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:29.501892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3ccde-6f5b-4e04-90a2-133bfbdbfb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:29.502900 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3ccde-6f5b-4e04-90a2-133bfbdbfb93 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:29.503275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3ccde-6f5b-4e04-90a2-133bfbdbfb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:29.503819 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3ccde-6f5b-4e04-90a2-133bfbdbfb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:29.504665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3ccde-6f5b-4e04-90a2-133bfbdbfb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:29.506515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3ccde-6f5b-4e04-90a2-133bfbdbfb93 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:29.520635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 962/1934] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:37:29.525062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86120477-b4fa-465c-874d-9e9a21c2afbf admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:29.538740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86120477-b4fa-465c-874d-9e9a21c2afbf admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:29.544982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409b5fe-e22c-4ea4-9651-e1e34afa9d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:29.545970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b5fe-e22c-4ea4-9651-e1e34afa9d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:29.549432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b5fe-e22c-4ea4-9651-e1e34afa9d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:29.549878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b5fe-e22c-4ea4-9651-e1e34afa9d7d admin admin] PATH_INFO: `/v3/projects/10001015666b479e933be8b35d3e85d5/users/15eb554599ab4833b4559e6e03107c32/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:29.557544 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409b5fe-e22c-4ea4-9651-e1e34afa9d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10001015666b479e933be8b35d3e85d5, user_id=15eb554599ab4833b4559e6e03107c32, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:29.560282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409b5fe-e22c-4ea4-9651-e1e34afa9d7d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:29.577324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 973/1935] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:37:29 2022] PUT /identity/v3/projects/10001015666b479e933be8b35d3e85d5/users/15eb554599ab4833b4559e6e03107c32/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:37:35.960008 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1b021-9394-4463-a4c6-ddf573bd5295 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:35.960624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1b021-9394-4463-a4c6-ddf573bd5295 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:35.960624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1b021-9394-4463-a4c6-ddf573bd5295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:35.998653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-70a1b021-9394-4463-a4c6-ddf573bd5295 None None] MFA Rules not processed for user `6efb487b68c4479b835517a9445578e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:35.999893 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-70a1b021-9394-4463-a4c6-ddf573bd5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:36.156139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 963/1936] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:36.741386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178e7c-f174-4cd2-bb14-1096f5e68595 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:36.741981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178e7c-f174-4cd2-bb14-1096f5e68595 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:36.742123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178e7c-f174-4cd2-bb14-1096f5e68595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:36.795942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f7178e7c-f174-4cd2-bb14-1096f5e68595 None None] MFA Rules not processed for user `15eb554599ab4833b4559e6e03107c32`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:36.799767 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f7178e7c-f174-4cd2-bb14-1096f5e68595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:36.914841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 974/1937] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:36.929149 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1b021-9394-4463-a4c6-ddf573bd5295 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:36.931334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-70a1b021-9394-4463-a4c6-ddf573bd5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:37.078908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1b021-9394-4463-a4c6-ddf573bd5295 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:37.084070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e5b43-f66c-4640-b625-2a64b11cbed3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b71b778b0b24cbb92446070934d68ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:37.086262 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e5b43-f66c-4640-b625-2a64b11cbed3 service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:37.086618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e5b43-f66c-4640-b625-2a64b11cbed3 service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:37.087173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e5b43-f66c-4640-b625-2a64b11cbed3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:37.211437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e5b43-f66c-4640-b625-2a64b11cbed3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:37.215580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e5b43-f66c-4640-b625-2a64b11cbed3 service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:37.248618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 964/1938] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:37.478431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534709da-0c6b-4ed4-aa79-87fcd52c1d71 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:37.481286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534709da-0c6b-4ed4-aa79-87fcd52c1d71 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:37.481286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534709da-0c6b-4ed4-aa79-87fcd52c1d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:37.513784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-534709da-0c6b-4ed4-aa79-87fcd52c1d71 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:37.515063 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-534709da-0c6b-4ed4-aa79-87fcd52c1d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:37.635697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 975/1939] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:37:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:37.654243 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e5b43-f66c-4640-b625-2a64b11cbed3 service glance] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:37.670824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:37.801710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e5b43-f66c-4640-b625-2a64b11cbed3 service glance] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:37.813783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa9b23-a543-4768-b97f-68f878840b03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:37.814919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa9b23-a543-4768-b97f-68f878840b03 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:37.815710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa9b23-a543-4768-b97f-68f878840b03 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:37.816228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa9b23-a543-4768-b97f-68f878840b03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:37.841405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa9b23-a543-4768-b97f-68f878840b03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:37.843700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa9b23-a543-4768-b97f-68f878840b03 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:37.856102 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 965/1940] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:37:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:37:47.626439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:47.849875 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=28 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:37:49.922048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe773d-5cc3-4389-8915-e9d732d6afb4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:49.922578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe773d-5cc3-4389-8915-e9d732d6afb4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:49.922578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe773d-5cc3-4389-8915-e9d732d6afb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:49.941402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4dbe773d-5cc3-4389-8915-e9d732d6afb4 None None] MFA Rules not processed for user `d743ca42c0ff416098c79749a0e3e3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:49.942598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4dbe773d-5cc3-4389-8915-e9d732d6afb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:49.949778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 976/1941] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:37:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:53.371068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e17cdd-455c-4544-ad81-fa2ad834a3da None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:53.371963 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e17cdd-455c-4544-ad81-fa2ad834a3da None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:53.372394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e17cdd-455c-4544-ad81-fa2ad834a3da None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:53.373776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 966/1942] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:37:53.380148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ba32-2703-41d2-9843-ffa91624d1c2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:53.380624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ba32-2703-41d2-9843-ffa91624d1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:53.380764 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ba32-2703-41d2-9843-ffa91624d1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:53.404713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1080ba32-2703-41d2-9843-ffa91624d1c2 None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:53.406352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1080ba32-2703-41d2-9843-ffa91624d1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:53.481325 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 977/1943] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:37:53.496735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e17cdd-455c-4544-ad81-fa2ad834a3da None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:53.501488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-12e17cdd-455c-4544-ad81-fa2ad834a3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:53.536449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e17cdd-455c-4544-ad81-fa2ad834a3da None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:53.541305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1d6dd-a383-4793-bb05-c9eb34b6c23a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b71b778b0b24cbb92446070934d68ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:53.541996 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1d6dd-a383-4793-bb05-c9eb34b6c23a service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:53.542345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1d6dd-a383-4793-bb05-c9eb34b6c23a service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:53.542880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1d6dd-a383-4793-bb05-c9eb34b6c23a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:53.563203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1d6dd-a383-4793-bb05-c9eb34b6c23a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:53.565262 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1d6dd-a383-4793-bb05-c9eb34b6c23a service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:53.581329 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 967/1944] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:53.705844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065bee-8296-4c25-ac2c-2ef4c6d34d4d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:53.706138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065bee-8296-4c25-ac2c-2ef4c6d34d4d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:53.706415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065bee-8296-4c25-ac2c-2ef4c6d34d4d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:53.708346 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 978/1945] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:37:53.714954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9000d0e-3b28-482f-9be1-343cc4bb9a97 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:53.715375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9000d0e-3b28-482f-9be1-343cc4bb9a97 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:53.715755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9000d0e-3b28-482f-9be1-343cc4bb9a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:53.742010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d9000d0e-3b28-482f-9be1-343cc4bb9a97 None None] MFA Rules not processed for user `aea5fababc0a497686549ed7b9b85c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:53.743858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d9000d0e-3b28-482f-9be1-343cc4bb9a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:53.827100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 968/1946] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:53.868663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7065bee-8296-4c25-ac2c-2ef4c6d34d4d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:53.880561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7065bee-8296-4c25-ac2c-2ef4c6d34d4d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:53.884781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8312dda-3216-41de-b7b4-292289f60755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:53.885399 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8312dda-3216-41de-b7b4-292289f60755 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:53.885677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8312dda-3216-41de-b7b4-292289f60755 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:53.885971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8312dda-3216-41de-b7b4-292289f60755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:53.893481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8312dda-3216-41de-b7b4-292289f60755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:53.895191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8312dda-3216-41de-b7b4-292289f60755 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:53.904381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 979/1947] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:53.995267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668868-1b5b-41ba-aa5a-c3bbc3673ade None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:53.995702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668868-1b5b-41ba-aa5a-c3bbc3673ade None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:53.996080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668868-1b5b-41ba-aa5a-c3bbc3673ade None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:53.997665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 969/1948] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:37:54.003501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b797e-d31c-4aa1-b036-5013ee63afaa None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:54.003837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b797e-d31c-4aa1-b036-5013ee63afaa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:54.004112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b797e-d31c-4aa1-b036-5013ee63afaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:54.023786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-064b797e-d31c-4aa1-b036-5013ee63afaa None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:54.025052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-064b797e-d31c-4aa1-b036-5013ee63afaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:54.034916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 980/1949] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:37:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:37:54.051783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22668868-1b5b-41ba-aa5a-c3bbc3673ade None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:54.063830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22668868-1b5b-41ba-aa5a-c3bbc3673ade None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:54.068517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d39275-4e38-4ee2-b94d-3fb332da3a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:54.069144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d39275-4e38-4ee2-b94d-3fb332da3a2c service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:54.069636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d39275-4e38-4ee2-b94d-3fb332da3a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:54.069938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d39275-4e38-4ee2-b94d-3fb332da3a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:54.087954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d39275-4e38-4ee2-b94d-3fb332da3a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:54.089718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d39275-4e38-4ee2-b94d-3fb332da3a2c service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:54.102360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 970/1950] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:37:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:37:54.501986 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762eb5b-221b-4de5-9889-077b2d1f1aaa None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:54.502859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762eb5b-221b-4de5-9889-077b2d1f1aaa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:54.503143 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762eb5b-221b-4de5-9889-077b2d1f1aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:54.531461 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6762eb5b-221b-4de5-9889-077b2d1f1aaa None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:37:54.533088 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6762eb5b-221b-4de5-9889-077b2d1f1aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:37:54.562161 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 981/1951] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:37:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:37:54.563141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d39275-4e38-4ee2-b94d-3fb332da3a2c service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:37:54.575182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d39275-4e38-4ee2-b94d-3fb332da3a2c service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:37:54.580333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1db5ad-3ba9-486c-8812-b308f0ae119a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:37:54.580979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1db5ad-3ba9-486c-8812-b308f0ae119a service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:37:54.581257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1db5ad-3ba9-486c-8812-b308f0ae119a service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:37:54.581527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1db5ad-3ba9-486c-8812-b308f0ae119a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:37:54.590877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1db5ad-3ba9-486c-8812-b308f0ae119a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:37:54.592529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1db5ad-3ba9-486c-8812-b308f0ae119a service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:37:54.602007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 971/1952] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:37:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:38:04.525900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=46 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:04.597785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=41 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:15.493471 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e2bf1-d3ca-461b-a001-af1862d4619f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:15.493888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e2bf1-d3ca-461b-a001-af1862d4619f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:15.494081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e2bf1-d3ca-461b-a001-af1862d4619f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:15.514155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7a2e2bf1-d3ca-461b-a001-af1862d4619f None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:38:15.515462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a2e2bf1-d3ca-461b-a001-af1862d4619f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:15.524018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 982/1953] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:38:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:38:15.536727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1db5ad-3ba9-486c-8812-b308f0ae119a service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:38:15.547806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08d867-36e5-47c2-bc73-a6639e0ec7a3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:15.548173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08d867-36e5-47c2-bc73-a6639e0ec7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:15.548538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08d867-36e5-47c2-bc73-a6639e0ec7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:15.549095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1db5ad-3ba9-486c-8812-b308f0ae119a service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:38:15.554829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce609-bb1a-441a-a8b9-6c2266ae700d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:38:15.555444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce609-bb1a-441a-a8b9-6c2266ae700d service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:15.555719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce609-bb1a-441a-a8b9-6c2266ae700d service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:15.555998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce609-bb1a-441a-a8b9-6c2266ae700d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:15.564560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ce609-bb1a-441a-a8b9-6c2266ae700d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:38:15.566107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ce609-bb1a-441a-a8b9-6c2266ae700d service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:38:15.570494 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5c08d867-36e5-47c2-bc73-a6639e0ec7a3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:38:15.571494 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5c08d867-36e5-47c2-bc73-a6639e0ec7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:15.577198 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 972/1954] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:38:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 03:38:15.654956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 983/1955] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:38:15.679835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce609-bb1a-441a-a8b9-6c2266ae700d service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:38:15.682452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-830ce609-bb1a-441a-a8b9-6c2266ae700d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:15.754083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce609-bb1a-441a-a8b9-6c2266ae700d service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:38:15.764448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededf392-0b8b-426d-b3c1-4e441b7a385a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:38:15.765426 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededf392-0b8b-426d-b3c1-4e441b7a385a service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:15.766014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededf392-0b8b-426d-b3c1-4e441b7a385a service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:15.766603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededf392-0b8b-426d-b3c1-4e441b7a385a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:15.781747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededf392-0b8b-426d-b3c1-4e441b7a385a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:38:15.783365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededf392-0b8b-426d-b3c1-4e441b7a385a service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:38:15.796267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 973/1956] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:38:25.646176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=30 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:25.789695 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=12 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:38:38.430919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2dff9-4c67-4bf7-a56e-71fd8487c6fd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:38.431463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2dff9-4c67-4bf7-a56e-71fd8487c6fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:38.431463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2dff9-4c67-4bf7-a56e-71fd8487c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:38.450727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ccf2dff9-4c67-4bf7-a56e-71fd8487c6fd None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:38:38.451913 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ccf2dff9-4c67-4bf7-a56e-71fd8487c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:38.459624 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 984/1957] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:38:38.482715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededf392-0b8b-426d-b3c1-4e441b7a385a service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:38:38.484384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ededf392-0b8b-426d-b3c1-4e441b7a385a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:38.499223 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededf392-0b8b-426d-b3c1-4e441b7a385a service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:38:38.505135 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90556b16-fb66-43f5-b044-0c10205eac8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:38:38.505762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90556b16-fb66-43f5-b044-0c10205eac8b service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:38.506040 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90556b16-fb66-43f5-b044-0c10205eac8b service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:38.506311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90556b16-fb66-43f5-b044-0c10205eac8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:38.514603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90556b16-fb66-43f5-b044-0c10205eac8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:38:38.516157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90556b16-fb66-43f5-b044-0c10205eac8b service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:38:38.526045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 974/1958] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:38:43.674630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300674-f3e7-4646-ba93-36bc8c259d04 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:43.675534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300674-f3e7-4646-ba93-36bc8c259d04 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:43.675810 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300674-f3e7-4646-ba93-36bc8c259d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:43.708597 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-79300674-f3e7-4646-ba93-36bc8c259d04 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:38:43.710044 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-79300674-f3e7-4646-ba93-36bc8c259d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:43.720453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 985/1959] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:38:43.747376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90556b16-fb66-43f5-b044-0c10205eac8b service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:38:43.763648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90556b16-fb66-43f5-b044-0c10205eac8b service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:38:43.771022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21355e-7025-4fd1-b918-21ec342790dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:38:43.771964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21355e-7025-4fd1-b918-21ec342790dd service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:43.772245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21355e-7025-4fd1-b918-21ec342790dd service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:43.772546 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21355e-7025-4fd1-b918-21ec342790dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:43.781840 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21355e-7025-4fd1-b918-21ec342790dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:38:43.783421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21355e-7025-4fd1-b918-21ec342790dd service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:38:43.793621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 975/1960] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:38:46.152591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99a67f-7bf1-4da7-9b67-65b3d9a671bd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:46.153106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99a67f-7bf1-4da7-9b67-65b3d9a671bd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:46.153201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99a67f-7bf1-4da7-9b67-65b3d9a671bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:46.174726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-df99a67f-7bf1-4da7-9b67-65b3d9a671bd None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:38:46.177044 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-df99a67f-7bf1-4da7-9b67-65b3d9a671bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:46.186004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 986/1961] 10.222.0.20 () {58 vars in 967 bytes} [Wed Nov 2 03:38:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:38:46.198357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21355e-7025-4fd1-b918-21ec342790dd service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:38:46.209318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21355e-7025-4fd1-b918-21ec342790dd service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:38:46.214834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb39ed5-21b6-449c-a719-f2a03af8fa73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:38:46.215438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb39ed5-21b6-449c-a719-f2a03af8fa73 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:46.215718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb39ed5-21b6-449c-a719-f2a03af8fa73 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:46.215991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb39ed5-21b6-449c-a719-f2a03af8fa73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:46.224361 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb39ed5-21b6-449c-a719-f2a03af8fa73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:38:46.226125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb39ed5-21b6-449c-a719-f2a03af8fa73 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:38:46.236522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 976/1962] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:38:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:38:48.056015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99a67f-7bf1-4da7-9b67-65b3d9a671bd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:38:48.065363 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99a67f-7bf1-4da7-9b67-65b3d9a671bd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:38:48.069015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e5389-1436-45e6-942b-085a11ca0fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:38:48.069623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e5389-1436-45e6-942b-085a11ca0fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:48.069908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e5389-1436-45e6-942b-085a11ca0fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:48.070185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e5389-1436-45e6-942b-085a11ca0fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:48.080084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e5389-1436-45e6-942b-085a11ca0fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:38:48.081565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e5389-1436-45e6-942b-085a11ca0fc6 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:38:48.091946 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 987/1963] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:38:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:38:51.993932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4312-64c2-4c3f-b844-00de4e340248 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:51.994482 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4312-64c2-4c3f-b844-00de4e340248 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:51.994482 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4312-64c2-4c3f-b844-00de4e340248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:52.024978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-22cc4312-64c2-4c3f-b844-00de4e340248 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:38:52.026486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-22cc4312-64c2-4c3f-b844-00de4e340248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:52.034992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 977/1964] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:38:52.148194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e5389-1436-45e6-942b-085a11ca0fc6 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:38:52.165243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e5389-1436-45e6-942b-085a11ca0fc6 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:38:52.171782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba37f8e-39a9-4e7b-8e9f-d49d2c570f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:38:52.172640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37f8e-39a9-4e7b-8e9f-d49d2c570f53 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:52.173103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37f8e-39a9-4e7b-8e9f-d49d2c570f53 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:52.173529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37f8e-39a9-4e7b-8e9f-d49d2c570f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:52.212097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba37f8e-39a9-4e7b-8e9f-d49d2c570f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:38:52.213979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba37f8e-39a9-4e7b-8e9f-d49d2c570f53 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:38:52.236055 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 988/1965] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:38:52.388694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4312-64c2-4c3f-b844-00de4e340248 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:38:52.391124 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-22cc4312-64c2-4c3f-b844-00de4e340248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:52.413283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4312-64c2-4c3f-b844-00de4e340248 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:38:52.418827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696f72f-0eee-4ca3-8235-165549c21183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:38:52.420256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f72f-0eee-4ca3-8235-165549c21183 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:52.420837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f72f-0eee-4ca3-8235-165549c21183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:52.421121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f72f-0eee-4ca3-8235-165549c21183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:52.422905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9696f72f-0eee-4ca3-8235-165549c21183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:52.438950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696f72f-0eee-4ca3-8235-165549c21183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:38:52.440765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696f72f-0eee-4ca3-8235-165549c21183 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:38:52.455108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 978/1966] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:38:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:38:54.403929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba37f8e-39a9-4e7b-8e9f-d49d2c570f53 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:38:54.413104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba37f8e-39a9-4e7b-8e9f-d49d2c570f53 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:38:54.416887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ec9f8-003c-4129-bdc4-6be0e9c00514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:38:54.417484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ec9f8-003c-4129-bdc4-6be0e9c00514 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:54.417768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ec9f8-003c-4129-bdc4-6be0e9c00514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:54.418045 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ec9f8-003c-4129-bdc4-6be0e9c00514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:54.419851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-868ec9f8-003c-4129-bdc4-6be0e9c00514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:54.434071 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ec9f8-003c-4129-bdc4-6be0e9c00514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:38:54.435479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ec9f8-003c-4129-bdc4-6be0e9c00514 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:38:54.447443 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 989/1967] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:38:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:38:57.216332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90128e70-9df8-4508-a6f5-64e2d608fe6f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:57.216890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90128e70-9df8-4508-a6f5-64e2d608fe6f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:57.217132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90128e70-9df8-4508-a6f5-64e2d608fe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:57.252044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-90128e70-9df8-4508-a6f5-64e2d608fe6f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:38:57.253291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-90128e70-9df8-4508-a6f5-64e2d608fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:38:57.262427 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 979/1968] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Nov 2 03:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:38:57.355615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ec9f8-003c-4129-bdc4-6be0e9c00514 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:38:57.366814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ec9f8-003c-4129-bdc4-6be0e9c00514 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:38:57.372178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c63435-ec60-4d80-b18e-359ee4f573ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:38:57.372796 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c63435-ec60-4d80-b18e-359ee4f573ed service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:38:57.373074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c63435-ec60-4d80-b18e-359ee4f573ed service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:38:57.373344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c63435-ec60-4d80-b18e-359ee4f573ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:38:57.381332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c63435-ec60-4d80-b18e-359ee4f573ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:38:57.382913 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c63435-ec60-4d80-b18e-359ee4f573ed service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:38:57.392316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 990/1969] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:39:07.246758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=30 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:07.387900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=33 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:09.870680 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90128e70-9df8-4508-a6f5-64e2d608fe6f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:39:09.883071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90128e70-9df8-4508-a6f5-64e2d608fe6f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:39:09.889342 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c76942-9b9a-42ff-8ad4-0183e2f66f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:39:09.889939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76942-9b9a-42ff-8ad4-0183e2f66f32 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:39:09.890219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76942-9b9a-42ff-8ad4-0183e2f66f32 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:39:09.890488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76942-9b9a-42ff-8ad4-0183e2f66f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:39:09.892433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-54c76942-9b9a-42ff-8ad4-0183e2f66f32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:09.964945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c76942-9b9a-42ff-8ad4-0183e2f66f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:39:09.966552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c76942-9b9a-42ff-8ad4-0183e2f66f32 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:39:09.976997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 980/1970] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:39:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:39:15.159223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5e23-fed8-49b1-b71a-91b6e77ebaa0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:39:15.159723 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5e23-fed8-49b1-b71a-91b6e77ebaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:39:15.159970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5e23-fed8-49b1-b71a-91b6e77ebaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:39:15.181219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-69ee5e23-fed8-49b1-b71a-91b6e77ebaa0 None None] MFA Rules not processed for user `71e75366f8b44eb1a0af9d7f8498c7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:39:15.181416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-69ee5e23-fed8-49b1-b71a-91b6e77ebaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:15.244094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 991/1971] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:39:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:39:15.456563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5310b1-4c34-4849-ab10-fe6697c34c99 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:39:15.457119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5310b1-4c34-4849-ab10-fe6697c34c99 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:39:15.457119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5310b1-4c34-4849-ab10-fe6697c34c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:39:15.484073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-db5310b1-4c34-4849-ab10-fe6697c34c99 None None] MFA Rules not processed for user `e0281fe66a8047f7ae0d8d7d48dc8470`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:39:15.485327 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-db5310b1-4c34-4849-ab10-fe6697c34c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:15.495331 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 981/1972] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:39:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:39:16.794348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5e23-fed8-49b1-b71a-91b6e77ebaa0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:39:16.795871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-69ee5e23-fed8-49b1-b71a-91b6e77ebaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:16.881831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5e23-fed8-49b1-b71a-91b6e77ebaa0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:39:16.887099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655b764-e9dc-4f2e-9820-30b5b4da71e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:39:16.887743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655b764-e9dc-4f2e-9820-30b5b4da71e9 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:39:16.888050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655b764-e9dc-4f2e-9820-30b5b4da71e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:39:16.888326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655b764-e9dc-4f2e-9820-30b5b4da71e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:39:16.890093 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4655b764-e9dc-4f2e-9820-30b5b4da71e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:16.902342 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655b764-e9dc-4f2e-9820-30b5b4da71e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:39:16.903740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655b764-e9dc-4f2e-9820-30b5b4da71e9 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:39:16.913727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 992/1973] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:39:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:39:21.495854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5310b1-4c34-4849-ab10-fe6697c34c99 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:39:21.520493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5310b1-4c34-4849-ab10-fe6697c34c99 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:39:21.520493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226c32-6782-4ce6-a47e-69baa4975127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:39:21.520493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226c32-6782-4ce6-a47e-69baa4975127 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:39:21.520493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226c32-6782-4ce6-a47e-69baa4975127 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:39:21.520960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226c32-6782-4ce6-a47e-69baa4975127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:39:21.520960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-75226c32-6782-4ce6-a47e-69baa4975127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:21.527424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75226c32-6782-4ce6-a47e-69baa4975127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:39:21.528959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75226c32-6782-4ce6-a47e-69baa4975127 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:39:21.547864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 982/1974] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:39:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:39:26.909525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=57 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:31.542967 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=37 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:36.392334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655b764-e9dc-4f2e-9820-30b5b4da71e9 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:39:36.393880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4655b764-e9dc-4f2e-9820-30b5b4da71e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:36.408656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655b764-e9dc-4f2e-9820-30b5b4da71e9 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:39:36.413092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:39:36.413789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:39:36.414069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:39:36.414337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] PATH_INFO: `/v3/users/6efb487b68c4479b835517a9445578e0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:39:36.415476 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efb487b68c4479b835517a9445578e0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:39:36.418320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:39:36.463947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efb487b68c4479b835517a9445578e0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:39:36.464641 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efb487b68c4479b835517a9445578e0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:39:36.471453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efb487b68c4479b835517a9445578e0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:39:36.478799 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efb487b68c4479b835517a9445578e0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:39:36.479410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efb487b68c4479b835517a9445578e0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:39:36.496620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 993/1975] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:39:36 2022] DELETE /identity/v3/users/6efb487b68c4479b835517a9445578e0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:39:36.668926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226c32-6782-4ce6-a47e-69baa4975127 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:39:36.680574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226c32-6782-4ce6-a47e-69baa4975127 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:39:36.738661 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:39:36.739296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:39:36.739576 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:39:36.739851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] PATH_INFO: `/v3/projects/432df74d9b2c4190bc69d1c588a37ac0` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:39:36.741021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432df74d9b2c4190bc69d1c588a37ac0)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:39:36.742957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:39:36.789551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432df74d9b2c4190bc69d1c588a37ac0', 'request_id': 'req-289975c9-9804-42fb-beb3-e8c147233745'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:39:36.796511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432df74d9b2c4190bc69d1c588a37ac0', 'request_id': 'req-289975c9-9804-42fb-beb3-e8c147233745'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:39:36.801898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432df74d9b2c4190bc69d1c588a37ac0', 'request_id': 'req-289975c9-9804-42fb-beb3-e8c147233745'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:39:36.813369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] The token cache is being invalidate because project 432df74d9b2c4190bc69d1c588a37ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:39:36.813655 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:39:36.814280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:39:36.816014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 983/1976] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:39:36 2022] DELETE /identity/v3/projects/432df74d9b2c4190bc69d1c588a37ac0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:39:46.493108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:46.810481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:39:54.777792 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:39:54.779414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:54.856243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e792-564a-4375-b181-09dfe213a183 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:39:54.919035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d307f-e6f2-40b2-ae31-d5f3df17ee33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:39:54.919648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d307f-e6f2-40b2-ae31-d5f3df17ee33 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:39:54.919934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d307f-e6f2-40b2-ae31-d5f3df17ee33 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:39:54.920202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d307f-e6f2-40b2-ae31-d5f3df17ee33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:39:54.921958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-891d307f-e6f2-40b2-ae31-d5f3df17ee33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:54.980357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d307f-e6f2-40b2-ae31-d5f3df17ee33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:39:54.981981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d307f-e6f2-40b2-ae31-d5f3df17ee33 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:39:54.991112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 994/1977] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:39:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:39:59.679919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:39:59.683304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:59.702949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289975c9-9804-42fb-beb3-e8c147233745 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:39:59.708831 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb23d1-89b7-43cf-b6b6-955d0c6ab340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:39:59.709497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb23d1-89b7-43cf-b6b6-955d0c6ab340 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:39:59.709891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb23d1-89b7-43cf-b6b6-955d0c6ab340 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:39:59.710101 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb23d1-89b7-43cf-b6b6-955d0c6ab340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:39:59.712420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-55fb23d1-89b7-43cf-b6b6-955d0c6ab340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:39:59.726097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb23d1-89b7-43cf-b6b6-955d0c6ab340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:39:59.727724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb23d1-89b7-43cf-b6b6-955d0c6ab340 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:39:59.740800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 984/1978] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:39:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:40:03.353937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150203e-18ae-4b1a-b735-a0093ca6c61d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:03.354385 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150203e-18ae-4b1a-b735-a0093ca6c61d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:03.354487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150203e-18ae-4b1a-b735-a0093ca6c61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:03.374281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f150203e-18ae-4b1a-b735-a0093ca6c61d None None] MFA Rules not processed for user `78ca6fbbda31433bbe598ce667103cae`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:40:03.375490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f150203e-18ae-4b1a-b735-a0093ca6c61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:03.382449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 995/1979] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:40:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:40:03.684665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb23d1-89b7-43cf-b6b6-955d0c6ab340 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:03.686190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-55fb23d1-89b7-43cf-b6b6-955d0c6ab340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:03.742995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb23d1-89b7-43cf-b6b6-955d0c6ab340 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:03.747552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999e45-01c9-4250-b896-c8e2cfd18d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:03.748154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999e45-01c9-4250-b896-c8e2cfd18d74 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:03.748438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999e45-01c9-4250-b896-c8e2cfd18d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:03.748749 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999e45-01c9-4250-b896-c8e2cfd18d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:03.750526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0c999e45-01c9-4250-b896-c8e2cfd18d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:03.759733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c999e45-01c9-4250-b896-c8e2cfd18d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:03.762166 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c999e45-01c9-4250-b896-c8e2cfd18d74 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:03.770002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 985/1980] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:40:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:40:12.272427 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150203e-18ae-4b1a-b735-a0093ca6c61d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:12.287652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150203e-18ae-4b1a-b735-a0093ca6c61d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:12.295927 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d659-ec6f-41c0-b113-20ddb6d2c6ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:12.296619 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d659-ec6f-41c0-b113-20ddb6d2c6ba service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:12.296969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d659-ec6f-41c0-b113-20ddb6d2c6ba service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:12.297317 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936d659-ec6f-41c0-b113-20ddb6d2c6ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:12.299118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f936d659-ec6f-41c0-b113-20ddb6d2c6ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:12.312263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936d659-ec6f-41c0-b113-20ddb6d2c6ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:12.313972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936d659-ec6f-41c0-b113-20ddb6d2c6ba service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:12.326226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 996/1981] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:40:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:40:13.766513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=32 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:21.256622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999e45-01c9-4250-b896-c8e2cfd18d74 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:21.258055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0c999e45-01c9-4250-b896-c8e2cfd18d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:21.313517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999e45-01c9-4250-b896-c8e2cfd18d74 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:21.317006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a6ba-b63e-4c49-bf30-494b2f1e53ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:21.317590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a6ba-b63e-4c49-bf30-494b2f1e53ef service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:21.317872 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a6ba-b63e-4c49-bf30-494b2f1e53ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:21.318148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a6ba-b63e-4c49-bf30-494b2f1e53ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:21.319849 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-02b0a6ba-b63e-4c49-bf30-494b2f1e53ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:21.377639 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a6ba-b63e-4c49-bf30-494b2f1e53ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:21.379059 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a6ba-b63e-4c49-bf30-494b2f1e53ef service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:21.388932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 986/1982] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:40:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:40:22.320759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:24.467976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d659-ec6f-41c0-b113-20ddb6d2c6ba service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:24.479989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936d659-ec6f-41c0-b113-20ddb6d2c6ba service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:24.497987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d815-2461-4232-88fa-f52b88191bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:24.498781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d815-2461-4232-88fa-f52b88191bf8 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:24.499061 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d815-2461-4232-88fa-f52b88191bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:24.499332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d815-2461-4232-88fa-f52b88191bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:24.501167 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-78d2d815-2461-4232-88fa-f52b88191bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:24.514338 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2d815-2461-4232-88fa-f52b88191bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:24.515846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2d815-2461-4232-88fa-f52b88191bf8 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:24.528952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 997/1983] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:40:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:40:27.211528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb30649-a81c-4654-9a99-e5d9c946b73b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:27.212028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb30649-a81c-4654-9a99-e5d9c946b73b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:27.212133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb30649-a81c-4654-9a99-e5d9c946b73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:27.231162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-beb30649-a81c-4654-9a99-e5d9c946b73b None None] MFA Rules not processed for user `cbdfd88ab0f448e48e86379efa48a8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:40:27.232345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-beb30649-a81c-4654-9a99-e5d9c946b73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:27.240236 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 987/1984] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:40:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:40:28.219502 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d815-2461-4232-88fa-f52b88191bf8 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:28.229375 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d815-2461-4232-88fa-f52b88191bf8 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:28.233682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ce812-81a1-4adf-85d7-a56bdb4976b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:28.234362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce812-81a1-4adf-85d7-a56bdb4976b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:28.235279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce812-81a1-4adf-85d7-a56bdb4976b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:28.235412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ce812-81a1-4adf-85d7-a56bdb4976b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:28.237669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-949ce812-81a1-4adf-85d7-a56bdb4976b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:28.300481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ce812-81a1-4adf-85d7-a56bdb4976b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:28.301935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ce812-81a1-4adf-85d7-a56bdb4976b4 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:28.312365 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 998/1985] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:40:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:40:37.225811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=51 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:38.308079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=34 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:52.037434 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb30649-a81c-4654-9a99-e5d9c946b73b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:52.047729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb30649-a81c-4654-9a99-e5d9c946b73b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:52.051477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d81e0-c7e4-4370-a6d2-8d7e7cc79c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:52.052087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d81e0-c7e4-4370-a6d2-8d7e7cc79c6d service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:52.052370 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d81e0-c7e4-4370-a6d2-8d7e7cc79c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:52.052679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d81e0-c7e4-4370-a6d2-8d7e7cc79c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:52.054449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0a1d81e0-c7e4-4370-a6d2-8d7e7cc79c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:52.116953 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d81e0-c7e4-4370-a6d2-8d7e7cc79c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:52.118317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d81e0-c7e4-4370-a6d2-8d7e7cc79c6d service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:52.128365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 988/1986] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:40:55.642676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ce812-81a1-4adf-85d7-a56bdb4976b4 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:55.644278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-949ce812-81a1-4adf-85d7-a56bdb4976b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:55.751075 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d81e0-c7e4-4370-a6d2-8d7e7cc79c6d service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:55.753529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0a1d81e0-c7e4-4370-a6d2-8d7e7cc79c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:55.762241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ce812-81a1-4adf-85d7-a56bdb4976b4 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:55.768761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bf8e2-4cd4-4ce2-adfb-bf5ca3017606 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:55.769476 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bf8e2-4cd4-4ce2-adfb-bf5ca3017606 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:55.770098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bf8e2-4cd4-4ce2-adfb-bf5ca3017606 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:55.770457 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bf8e2-4cd4-4ce2-adfb-bf5ca3017606 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:55.772487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-091bf8e2-4cd4-4ce2-adfb-bf5ca3017606 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:55.774603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d81e0-c7e4-4370-a6d2-8d7e7cc79c6d service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:55.781171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:55.783386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:55.783684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:55.784001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] PATH_INFO: `/v3/users/71e75366f8b44eb1a0af9d7f8498c7f5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:55.787700 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bf8e2-4cd4-4ce2-adfb-bf5ca3017606 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:55.788660 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e75366f8b44eb1a0af9d7f8498c7f5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:55.789553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bf8e2-4cd4-4ce2-adfb-bf5ca3017606 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:55.792022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:55.805703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 999/1987] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:40:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:40:55.865112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e75366f8b44eb1a0af9d7f8498c7f5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:55.865964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e75366f8b44eb1a0af9d7f8498c7f5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:55.874264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e75366f8b44eb1a0af9d7f8498c7f5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:55.875117 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e75366f8b44eb1a0af9d7f8498c7f5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:55.896813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-619397fc-edaa-4e83-b2a3-e1762b32ecf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e75366f8b44eb1a0af9d7f8498c7f5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:55.905634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 989/1988] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:40:55 2022] DELETE /identity/v3/users/71e75366f8b44eb1a0af9d7f8498c7f5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:40:56.090975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bf8e2-4cd4-4ce2-adfb-bf5ca3017606 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:56.108574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bf8e2-4cd4-4ce2-adfb-bf5ca3017606 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:56.169630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:56.170273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:56.170556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:56.170830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] PATH_INFO: `/v3/projects/aa9d3f9a9c564b89a23064fe52265f59` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:56.171949 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9d3f9a9c564b89a23064fe52265f59)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:56.173923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:56.222844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9d3f9a9c564b89a23064fe52265f59', 'request_id': 'req-d6f81377-e70a-418c-aa0d-03444198851e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:56.229527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9d3f9a9c564b89a23064fe52265f59', 'request_id': 'req-d6f81377-e70a-418c-aa0d-03444198851e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:56.238574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9d3f9a9c564b89a23064fe52265f59', 'request_id': 'req-d6f81377-e70a-418c-aa0d-03444198851e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:56.254145 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] The token cache is being invalidate because project aa9d3f9a9c564b89a23064fe52265f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:40:56.254708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:56.256500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6f81377-e70a-418c-aa0d-03444198851e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:56.258550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1000/1989] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:40:56 2022] DELETE /identity/v3/projects/aa9d3f9a9c564b89a23064fe52265f59 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:40:56.264054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68de18-7cdc-4b59-9f99-05e9d2c1eaba None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:56.264630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68de18-7cdc-4b59-9f99-05e9d2c1eaba None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:56.265001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68de18-7cdc-4b59-9f99-05e9d2c1eaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:56.287475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ef68de18-7cdc-4b59-9f99-05e9d2c1eaba None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:40:56.288892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ef68de18-7cdc-4b59-9f99-05e9d2c1eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:56.362521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 990/1990] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:40:56.370763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954dfdd-d95a-4ea5-8ab1-998fa4acde67 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:56.371055 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954dfdd-d95a-4ea5-8ab1-998fa4acde67 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:56.371326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954dfdd-d95a-4ea5-8ab1-998fa4acde67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:56.396139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d954dfdd-d95a-4ea5-8ab1-998fa4acde67 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:40:56.397380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d954dfdd-d95a-4ea5-8ab1-998fa4acde67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:56.409247 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1001/1991] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:40:56.412284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68de18-7cdc-4b59-9f99-05e9d2c1eaba None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:56.423997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68de18-7cdc-4b59-9f99-05e9d2c1eaba None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:56.429029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035cbb7-f3d8-4858-840b-b8a1c45f25b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:56.429644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035cbb7-f3d8-4858-840b-b8a1c45f25b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:56.429922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035cbb7-f3d8-4858-840b-b8a1c45f25b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:56.430189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035cbb7-f3d8-4858-840b-b8a1c45f25b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:56.430837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035cbb7-f3d8-4858-840b-b8a1c45f25b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:40:56.431135 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035cbb7-f3d8-4858-840b-b8a1c45f25b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:56.433305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035cbb7-f3d8-4858-840b-b8a1c45f25b4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:56.434982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:56.447633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 991/1992] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:40:56.452190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954dfdd-d95a-4ea5-8ab1-998fa4acde67 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:56.461579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954dfdd-d95a-4ea5-8ab1-998fa4acde67 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:56.467075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37596c10-e3e0-4bee-9a81-eb4d0ba3451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:56.467689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596c10-e3e0-4bee-9a81-eb4d0ba3451b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:56.467969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596c10-e3e0-4bee-9a81-eb4d0ba3451b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:56.468242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596c10-e3e0-4bee-9a81-eb4d0ba3451b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:56.468938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37596c10-e3e0-4bee-9a81-eb4d0ba3451b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:56.470846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37596c10-e3e0-4bee-9a81-eb4d0ba3451b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:56.483144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:56.512216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1002/1993] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:40:56 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:40:56.516713 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035cbb7-f3d8-4858-840b-b8a1c45f25b4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:56.527829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035cbb7-f3d8-4858-840b-b8a1c45f25b4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:56.624250 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f89cda-9709-42fe-9d02-8f89a876f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:56.625998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f89cda-9709-42fe-9d02-8f89a876f81d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:56.626709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f89cda-9709-42fe-9d02-8f89a876f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:56.627139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f89cda-9709-42fe-9d02-8f89a876f81d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:56.627923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f89cda-9709-42fe-9d02-8f89a876f81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:56.630096 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f89cda-9709-42fe-9d02-8f89a876f81d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:56.663602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 992/1994] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:40:56 2022] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:40:56.665032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37596c10-e3e0-4bee-9a81-eb4d0ba3451b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:56.676810 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37596c10-e3e0-4bee-9a81-eb4d0ba3451b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:56.685204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94884bde-c616-49f2-add4-0ea2104ec4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:56.686140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94884bde-c616-49f2-add4-0ea2104ec4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:56.686501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94884bde-c616-49f2-add4-0ea2104ec4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:56.686873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94884bde-c616-49f2-add4-0ea2104ec4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:56.687804 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94884bde-c616-49f2-add4-0ea2104ec4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:56.689575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94884bde-c616-49f2-add4-0ea2104ec4e3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:56.703770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1003/1995] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:40:56.707907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f89cda-9709-42fe-9d02-8f89a876f81d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:56.722171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f89cda-9709-42fe-9d02-8f89a876f81d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:56.728188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995d19b-07f7-4048-ba76-b4fb85e84569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:56.728892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995d19b-07f7-4048-ba76-b4fb85e84569 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:56.729169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995d19b-07f7-4048-ba76-b4fb85e84569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:56.729630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995d19b-07f7-4048-ba76-b4fb85e84569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:56.730287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995d19b-07f7-4048-ba76-b4fb85e84569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:56.732066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995d19b-07f7-4048-ba76-b4fb85e84569 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:56.744559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 993/1996] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:40:56.749144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94884bde-c616-49f2-add4-0ea2104ec4e3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:56.762611 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94884bde-c616-49f2-add4-0ea2104ec4e3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:56.767545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f0e33-a7fd-482e-8c9e-3347288a475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:56.768303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0e33-a7fd-482e-8c9e-3347288a475c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:56.768730 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0e33-a7fd-482e-8c9e-3347288a475c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:56.769626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0e33-a7fd-482e-8c9e-3347288a475c admin admin] PATH_INFO: `/v3/projects/98bf6cee0e0e441c9c2a46db34f45f35/users/70e8adfb675b40b28a9899169c21f84a/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:56.790671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f0e33-a7fd-482e-8c9e-3347288a475c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bf6cee0e0e441c9c2a46db34f45f35, user_id=70e8adfb675b40b28a9899169c21f84a, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:56.794278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f0e33-a7fd-482e-8c9e-3347288a475c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:56.816554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1004/1997] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:40:56 2022] PUT /identity/v3/projects/98bf6cee0e0e441c9c2a46db34f45f35/users/70e8adfb675b40b28a9899169c21f84a/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:40:56.827476 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8196f1d-b148-4f99-a12d-a131e4cdc849 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:56.827979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8196f1d-b148-4f99-a12d-a131e4cdc849 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:56.828317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8196f1d-b148-4f99-a12d-a131e4cdc849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:56.873668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e8196f1d-b148-4f99-a12d-a131e4cdc849 None None] MFA Rules not processed for user `70e8adfb675b40b28a9899169c21f84a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:40:56.875050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e8196f1d-b148-4f99-a12d-a131e4cdc849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:56.956395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 994/1998] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:40:56 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:40:56.961325 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f0e33-a7fd-482e-8c9e-3347288a475c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:57.034787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f0e33-a7fd-482e-8c9e-3347288a475c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:57.039456 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfa8f6-dc9b-448b-8bc5-e7b375e85c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:57.040194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfa8f6-dc9b-448b-8bc5-e7b375e85c4b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:57.040504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfa8f6-dc9b-448b-8bc5-e7b375e85c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:57.040815 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfa8f6-dc9b-448b-8bc5-e7b375e85c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:57.041538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfa8f6-dc9b-448b-8bc5-e7b375e85c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:57.043386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfa8f6-dc9b-448b-8bc5-e7b375e85c4b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:57.072734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1005/1999] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:40:56 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:40:57.077081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8196f1d-b148-4f99-a12d-a131e4cdc849 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:57.087986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8196f1d-b148-4f99-a12d-a131e4cdc849 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:57.147336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4903c6b-89bc-4ffa-9e76-4f1ee883e736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:57.147958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4903c6b-89bc-4ffa-9e76-4f1ee883e736 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:57.148244 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4903c6b-89bc-4ffa-9e76-4f1ee883e736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:57.148547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4903c6b-89bc-4ffa-9e76-4f1ee883e736 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:57.149188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4903c6b-89bc-4ffa-9e76-4f1ee883e736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:57.151833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4903c6b-89bc-4ffa-9e76-4f1ee883e736 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:57.161452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:57.179880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 995/2000] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:40:57 2022] POST /identity/v3/users => generated 309 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:40:57.181122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfa8f6-dc9b-448b-8bc5-e7b375e85c4b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:57.193052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfa8f6-dc9b-448b-8bc5-e7b375e85c4b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:57.198688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca15e0f-2869-4b10-8d34-a0288e7483cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:57.199350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca15e0f-2869-4b10-8d34-a0288e7483cc admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:57.199635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca15e0f-2869-4b10-8d34-a0288e7483cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:57.199919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca15e0f-2869-4b10-8d34-a0288e7483cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:57.200697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca15e0f-2869-4b10-8d34-a0288e7483cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:57.202668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca15e0f-2869-4b10-8d34-a0288e7483cc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:57.220648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1006/2001] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:40:57.221926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4903c6b-89bc-4ffa-9e76-4f1ee883e736 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:57.234189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4903c6b-89bc-4ffa-9e76-4f1ee883e736 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:57.239117 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba421d5-66b2-43c5-a538-c92e6c2703a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:57.239784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba421d5-66b2-43c5-a538-c92e6c2703a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:57.240097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba421d5-66b2-43c5-a538-c92e6c2703a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:57.240374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba421d5-66b2-43c5-a538-c92e6c2703a0 admin admin] PATH_INFO: `/v3/projects/c4dcc5e5b5da4f9ca701abaf8b290c98/users/048e958847ce40e4992f44052881338b/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:57.261026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba421d5-66b2-43c5-a538-c92e6c2703a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dcc5e5b5da4f9ca701abaf8b290c98, user_id=048e958847ce40e4992f44052881338b, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:57.263977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba421d5-66b2-43c5-a538-c92e6c2703a0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:57.281509 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 996/2002] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:40:57 2022] PUT /identity/v3/projects/c4dcc5e5b5da4f9ca701abaf8b290c98/users/048e958847ce40e4992f44052881338b/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:40:57.286228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca15e0f-2869-4b10-8d34-a0288e7483cc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:57.300971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca15e0f-2869-4b10-8d34-a0288e7483cc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:57.371493 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cbf74-15f8-4987-b109-2f8736bde480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:57.372112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cbf74-15f8-4987-b109-2f8736bde480 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:57.372389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cbf74-15f8-4987-b109-2f8736bde480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:57.372688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cbf74-15f8-4987-b109-2f8736bde480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:57.373340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cbf74-15f8-4987-b109-2f8736bde480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:57.374916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cbf74-15f8-4987-b109-2f8736bde480 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:57.384900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1007/2003] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:40:57.389334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba421d5-66b2-43c5-a538-c92e6c2703a0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:57.400297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba421d5-66b2-43c5-a538-c92e6c2703a0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:57.405446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bfd63-72d3-468d-8ec1-583bd4f82919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:57.406204 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bfd63-72d3-468d-8ec1-583bd4f82919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:57.406486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bfd63-72d3-468d-8ec1-583bd4f82919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:57.406761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bfd63-72d3-468d-8ec1-583bd4f82919 admin admin] PATH_INFO: `/v3/projects/c4dcc5e5b5da4f9ca701abaf8b290c98/users/048e958847ce40e4992f44052881338b/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:57.408818 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bfd63-72d3-468d-8ec1-583bd4f82919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dcc5e5b5da4f9ca701abaf8b290c98, user_id=048e958847ce40e4992f44052881338b, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:57.411578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bfd63-72d3-468d-8ec1-583bd4f82919 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:57.423413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 997/2004] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:40:57 2022] PUT /identity/v3/projects/c4dcc5e5b5da4f9ca701abaf8b290c98/users/048e958847ce40e4992f44052881338b/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:40:57.434489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff92ba-4289-4128-be8d-1cf7d069a386 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:57.434853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff92ba-4289-4128-be8d-1cf7d069a386 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:57.435138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff92ba-4289-4128-be8d-1cf7d069a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:57.465382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3aff92ba-4289-4128-be8d-1cf7d069a386 None None] MFA Rules not processed for user `048e958847ce40e4992f44052881338b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:40:57.467031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3aff92ba-4289-4128-be8d-1cf7d069a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:57.482149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:57.540108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1008/2005] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:40:57 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:40:57.551785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bfd63-72d3-468d-8ec1-583bd4f82919 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:57.553495 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-455bfd63-72d3-468d-8ec1-583bd4f82919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:57.615291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bfd63-72d3-468d-8ec1-583bd4f82919 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:57.619691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0f223-a282-4ea4-b9ff-210f4fda0c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:57.620308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0f223-a282-4ea4-b9ff-210f4fda0c71 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:57.620609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0f223-a282-4ea4-b9ff-210f4fda0c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:57.621176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0f223-a282-4ea4-b9ff-210f4fda0c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:57.630782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0f223-a282-4ea4-b9ff-210f4fda0c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:57.632217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0f223-a282-4ea4-b9ff-210f4fda0c71 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:57.642248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 998/2006] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:40:57 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:40:57.792828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff92ba-4289-4128-be8d-1cf7d069a386 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:57.855774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff92ba-4289-4128-be8d-1cf7d069a386 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:57.860559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:57.861187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:57.861470 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:57.861771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] PATH_INFO: `/v3/users/70e8adfb675b40b28a9899169c21f84a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:57.862887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e8adfb675b40b28a9899169c21f84a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:57.864826 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:57.911287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e8adfb675b40b28a9899169c21f84a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:57.911925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e8adfb675b40b28a9899169c21f84a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:57.920125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e8adfb675b40b28a9899169c21f84a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:57.927436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e8adfb675b40b28a9899169c21f84a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:57.928085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e8adfb675b40b28a9899169c21f84a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:57.945185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1009/2007] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:40:57 2022] DELETE /identity/v3/users/70e8adfb675b40b28a9899169c21f84a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:40:57.949901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fedb4-d622-40f5-98d6-0ddb183de69d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:57.950413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fedb4-d622-40f5-98d6-0ddb183de69d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:57.950511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fedb4-d622-40f5-98d6-0ddb183de69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:57.969484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-781fedb4-d622-40f5-98d6-0ddb183de69d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:40:57.970705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-781fedb4-d622-40f5-98d6-0ddb183de69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:58.028901 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 999/2008] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:40:58.039266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:58.041502 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:58.078941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:58.106965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49d3a-bacf-44d7-995a-5a0d2256da3f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:58.110861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f363c2-f52a-4367-8a6a-1124c321adeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:58.111478 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f363c2-f52a-4367-8a6a-1124c321adeb service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:58.111760 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f363c2-f52a-4367-8a6a-1124c321adeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:58.112031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f363c2-f52a-4367-8a6a-1124c321adeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:58.121379 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f363c2-f52a-4367-8a6a-1124c321adeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:58.123038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f363c2-f52a-4367-8a6a-1124c321adeb service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:58.132481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1010/2009] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:40:58.421776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fedb4-d622-40f5-98d6-0ddb183de69d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:58.423510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-781fedb4-d622-40f5-98d6-0ddb183de69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:58.442818 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fedb4-d622-40f5-98d6-0ddb183de69d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:58.449539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:58.450315 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:58.450813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:58.451211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] PATH_INFO: `/v3/projects/98bf6cee0e0e441c9c2a46db34f45f35` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:58.452835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bf6cee0e0e441c9c2a46db34f45f35)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:58.454949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:58.504201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bf6cee0e0e441c9c2a46db34f45f35', 'request_id': 'req-7ee30119-8324-49c6-a664-f3148b0678ac'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:58.508176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:58.513456 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bf6cee0e0e441c9c2a46db34f45f35', 'request_id': 'req-7ee30119-8324-49c6-a664-f3148b0678ac'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:58.520855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bf6cee0e0e441c9c2a46db34f45f35', 'request_id': 'req-7ee30119-8324-49c6-a664-f3148b0678ac'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:58.532949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] The token cache is being invalidate because project 98bf6cee0e0e441c9c2a46db34f45f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:40:58.533160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:58.533827 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:58.535309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1000/2010] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:40:58 2022] DELETE /identity/v3/projects/98bf6cee0e0e441c9c2a46db34f45f35 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:40:58.539205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f363c2-f52a-4367-8a6a-1124c321adeb service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:58.549724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f363c2-f52a-4367-8a6a-1124c321adeb service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:58.610507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:58.611147 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:58.611429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:58.611703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] PATH_INFO: `/v3/users/048e958847ce40e4992f44052881338b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:58.612948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048e958847ce40e4992f44052881338b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:58.614927 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:58.663990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048e958847ce40e4992f44052881338b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:58.665131 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048e958847ce40e4992f44052881338b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:58.673279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048e958847ce40e4992f44052881338b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:58.680928 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048e958847ce40e4992f44052881338b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:58.682233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e966ba6-bd34-40e0-b035-53de7fd1dcd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048e958847ce40e4992f44052881338b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:58.700813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1011/2011] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:40:58 2022] DELETE /identity/v3/users/048e958847ce40e4992f44052881338b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:40:59.078825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:59.080330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:59.093736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30119-8324-49c6-a664-f3148b0678ac admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:59.157245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:59.157877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.158707 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.158707 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] PATH_INFO: `/v3/projects/c4dcc5e5b5da4f9ca701abaf8b290c98` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.159566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4dcc5e5b5da4f9ca701abaf8b290c98)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:59.161625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:59.216334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4dcc5e5b5da4f9ca701abaf8b290c98', 'request_id': 'req-481d59f4-d20c-4c80-8f38-cb3b348135ab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:59.223659 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4dcc5e5b5da4f9ca701abaf8b290c98', 'request_id': 'req-481d59f4-d20c-4c80-8f38-cb3b348135ab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:59.230959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4dcc5e5b5da4f9ca701abaf8b290c98', 'request_id': 'req-481d59f4-d20c-4c80-8f38-cb3b348135ab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:59.242690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] The token cache is being invalidate because project c4dcc5e5b5da4f9ca701abaf8b290c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:40:59.243056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:59.244611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-481d59f4-d20c-4c80-8f38-cb3b348135ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:40:59.246232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1001/2012] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:40:59 2022] DELETE /identity/v3/projects/c4dcc5e5b5da4f9ca701abaf8b290c98 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:40:59.252135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75b106-e60b-4668-a481-2ab4dfe5d6d4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.252677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75b106-e60b-4668-a481-2ab4dfe5d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.252794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75b106-e60b-4668-a481-2ab4dfe5d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.273539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-de75b106-e60b-4668-a481-2ab4dfe5d6d4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:40:59.274901 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-de75b106-e60b-4668-a481-2ab4dfe5d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:59.327458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:59.342208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1012/2013] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:40:59.350584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234791a-ea9a-4b95-a30c-f2d50e72f66e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.350878 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234791a-ea9a-4b95-a30c-f2d50e72f66e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.351153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234791a-ea9a-4b95-a30c-f2d50e72f66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.373407 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7234791a-ea9a-4b95-a30c-f2d50e72f66e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:40:59.375328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7234791a-ea9a-4b95-a30c-f2d50e72f66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:59.383083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1002/2014] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:40:59.387023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75b106-e60b-4668-a481-2ab4dfe5d6d4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:59.396968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75b106-e60b-4668-a481-2ab4dfe5d6d4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:59.402218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198bdd4-1bbe-4489-aa96-a1529260368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:59.402859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198bdd4-1bbe-4489-aa96-a1529260368d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.403145 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198bdd4-1bbe-4489-aa96-a1529260368d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.403425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198bdd4-1bbe-4489-aa96-a1529260368d admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.404080 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198bdd4-1bbe-4489-aa96-a1529260368d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:40:59.404386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198bdd4-1bbe-4489-aa96-a1529260368d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:59.406151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198bdd4-1bbe-4489-aa96-a1529260368d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:59.418705 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1013/2015] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:40:59.423645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234791a-ea9a-4b95-a30c-f2d50e72f66e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:59.433166 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234791a-ea9a-4b95-a30c-f2d50e72f66e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:59.438189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced8994-abe7-4cc9-a3ae-a27a1cb5348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:59.438904 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced8994-abe7-4cc9-a3ae-a27a1cb5348f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.439419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced8994-abe7-4cc9-a3ae-a27a1cb5348f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.439776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced8994-abe7-4cc9-a3ae-a27a1cb5348f admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.440628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced8994-abe7-4cc9-a3ae-a27a1cb5348f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:59.442605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced8994-abe7-4cc9-a3ae-a27a1cb5348f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:59.471324 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1003/2016] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:40:59 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:40:59.475947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198bdd4-1bbe-4489-aa96-a1529260368d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:59.487632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198bdd4-1bbe-4489-aa96-a1529260368d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:59.546628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6ed4-44c9-4569-a93c-9f9b7c31107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:59.547244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6ed4-44c9-4569-a93c-9f9b7c31107f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.547528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6ed4-44c9-4569-a93c-9f9b7c31107f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.547813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6ed4-44c9-4569-a93c-9f9b7c31107f admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.548482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6ed4-44c9-4569-a93c-9f9b7c31107f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:59.550414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6ed4-44c9-4569-a93c-9f9b7c31107f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:59.571488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1014/2017] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:40:59 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:40:59.575682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced8994-abe7-4cc9-a3ae-a27a1cb5348f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:59.586335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced8994-abe7-4cc9-a3ae-a27a1cb5348f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:59.591763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d20e9-6c02-412b-bb94-fe09ae1c3e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:59.592365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d20e9-6c02-412b-bb94-fe09ae1c3e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.592675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d20e9-6c02-412b-bb94-fe09ae1c3e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.593077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d20e9-6c02-412b-bb94-fe09ae1c3e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.593717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d20e9-6c02-412b-bb94-fe09ae1c3e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:59.595307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d20e9-6c02-412b-bb94-fe09ae1c3e3e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:59.606102 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1004/2018] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:40:59.610485 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6ed4-44c9-4569-a93c-9f9b7c31107f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:59.620801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6ed4-44c9-4569-a93c-9f9b7c31107f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:59.625620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc7ad5-9191-491b-ae4f-3f3f0d0aaf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:59.626222 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc7ad5-9191-491b-ae4f-3f3f0d0aaf18 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.626504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc7ad5-9191-491b-ae4f-3f3f0d0aaf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.626780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc7ad5-9191-491b-ae4f-3f3f0d0aaf18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.627424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc7ad5-9191-491b-ae4f-3f3f0d0aaf18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:59.629090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc7ad5-9191-491b-ae4f-3f3f0d0aaf18 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:59.640493 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1015/2019] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:40:59.645225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d20e9-6c02-412b-bb94-fe09ae1c3e3e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:59.656722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d20e9-6c02-412b-bb94-fe09ae1c3e3e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:59.661500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72e979-1d87-493c-9d7e-04b850311084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:59.662238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e979-1d87-493c-9d7e-04b850311084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.662584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e979-1d87-493c-9d7e-04b850311084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.662873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e979-1d87-493c-9d7e-04b850311084 admin admin] PATH_INFO: `/v3/projects/863aaaf03af548ccaaea7065a8db2660/users/f929ed89a2cb4023a34bf772a2d2c410/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.677909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e979-1d87-493c-9d7e-04b850311084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863aaaf03af548ccaaea7065a8db2660, user_id=f929ed89a2cb4023a34bf772a2d2c410, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:59.680614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e979-1d87-493c-9d7e-04b850311084 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:59.698137 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1005/2020] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:40:59 2022] PUT /identity/v3/projects/863aaaf03af548ccaaea7065a8db2660/users/f929ed89a2cb4023a34bf772a2d2c410/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:40:59.705729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1dff2-8cf5-4306-99c8-278aa4b6bb15 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.706024 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1dff2-8cf5-4306-99c8-278aa4b6bb15 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.706299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1dff2-8cf5-4306-99c8-278aa4b6bb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.737091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a8b1dff2-8cf5-4306-99c8-278aa4b6bb15 None None] MFA Rules not processed for user `f929ed89a2cb4023a34bf772a2d2c410`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:40:59.738359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a8b1dff2-8cf5-4306-99c8-278aa4b6bb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:40:59.809110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1016/2021] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:40:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:40:59.813653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72e979-1d87-493c-9d7e-04b850311084 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:59.824592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:40:59.886393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72e979-1d87-493c-9d7e-04b850311084 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:59.891197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef7d75-4cfd-4e5c-bc41-f46f23239574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:40:59.891816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef7d75-4cfd-4e5c-bc41-f46f23239574 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:40:59.892100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef7d75-4cfd-4e5c-bc41-f46f23239574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:40:59.892378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef7d75-4cfd-4e5c-bc41-f46f23239574 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:40:59.893052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef7d75-4cfd-4e5c-bc41-f46f23239574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:40:59.894956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef7d75-4cfd-4e5c-bc41-f46f23239574 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:40:59.926604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1006/2022] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:40:59 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:40:59.927819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1dff2-8cf5-4306-99c8-278aa4b6bb15 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:40:59.939382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1dff2-8cf5-4306-99c8-278aa4b6bb15 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:40:59.989749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:00.007211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd94a87-e0e3-4741-bf19-4593374ba61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:00.007832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd94a87-e0e3-4741-bf19-4593374ba61c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:00.008159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd94a87-e0e3-4741-bf19-4593374ba61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:00.008435 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd94a87-e0e3-4741-bf19-4593374ba61c admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:00.009092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd94a87-e0e3-4741-bf19-4593374ba61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:00.011603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd94a87-e0e3-4741-bf19-4593374ba61c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:00.033508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1017/2023] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:40:59 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:41:00.037589 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef7d75-4cfd-4e5c-bc41-f46f23239574 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:00.050228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef7d75-4cfd-4e5c-bc41-f46f23239574 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:00.055178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb9079-c992-49be-8d20-9fdb26bb6a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:00.055941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb9079-c992-49be-8d20-9fdb26bb6a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:00.056773 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb9079-c992-49be-8d20-9fdb26bb6a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:00.057060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb9079-c992-49be-8d20-9fdb26bb6a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:00.057772 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb9079-c992-49be-8d20-9fdb26bb6a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:00.059360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb9079-c992-49be-8d20-9fdb26bb6a3c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:00.074807 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1007/2024] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:41:00.076480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd94a87-e0e3-4741-bf19-4593374ba61c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:00.086569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd94a87-e0e3-4741-bf19-4593374ba61c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:00.091702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7faf9-47cd-4833-a154-b9333a900484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:00.092354 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7faf9-47cd-4833-a154-b9333a900484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:00.092658 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7faf9-47cd-4833-a154-b9333a900484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:00.092937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7faf9-47cd-4833-a154-b9333a900484 admin admin] PATH_INFO: `/v3/projects/2c4b90c0e9bc46f489dbec90b5bfe25e/users/b1fa8ccdcf664c43935e7a2f2bb6d0b9/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:00.109987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7faf9-47cd-4833-a154-b9333a900484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4b90c0e9bc46f489dbec90b5bfe25e, user_id=b1fa8ccdcf664c43935e7a2f2bb6d0b9, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:00.112755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7faf9-47cd-4833-a154-b9333a900484 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:00.130196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1018/2025] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:41:00 2022] PUT /identity/v3/projects/2c4b90c0e9bc46f489dbec90b5bfe25e/users/b1fa8ccdcf664c43935e7a2f2bb6d0b9/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:41:00.136609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb9079-c992-49be-8d20-9fdb26bb6a3c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:00.144996 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49cb9-8e01-46ae-9b01-77b01b609e45 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:00.145311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49cb9-8e01-46ae-9b01-77b01b609e45 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:00.145594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49cb9-8e01-46ae-9b01-77b01b609e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:00.146395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb9079-c992-49be-8d20-9fdb26bb6a3c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:00.166591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-16b49cb9-8e01-46ae-9b01-77b01b609e45 None None] MFA Rules not processed for user `e0281fe66a8047f7ae0d8d7d48dc8470`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:00.167941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-16b49cb9-8e01-46ae-9b01-77b01b609e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:00.204507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ab8cc-cb71-48a2-a8a1-836aa74a5fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:00.205222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ab8cc-cb71-48a2-a8a1-836aa74a5fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:00.205503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ab8cc-cb71-48a2-a8a1-836aa74a5fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:00.205781 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ab8cc-cb71-48a2-a8a1-836aa74a5fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:00.206409 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ab8cc-cb71-48a2-a8a1-836aa74a5fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:00.208194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ab8cc-cb71-48a2-a8a1-836aa74a5fb9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:00.221909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1008/2026] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:41:00.222870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ab8cc-cb71-48a2-a8a1-836aa74a5fb9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:00.223987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1019/2027] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:41:00.233541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ab8cc-cb71-48a2-a8a1-836aa74a5fb9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:00.238690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4fa23-fc31-4525-b377-448e9ad4b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:00.239335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4fa23-fc31-4525-b377-448e9ad4b00e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:00.239614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4fa23-fc31-4525-b377-448e9ad4b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:00.239886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4fa23-fc31-4525-b377-448e9ad4b00e admin admin] PATH_INFO: `/v3/projects/2c4b90c0e9bc46f489dbec90b5bfe25e/users/b1fa8ccdcf664c43935e7a2f2bb6d0b9/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:00.241818 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4fa23-fc31-4525-b377-448e9ad4b00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4b90c0e9bc46f489dbec90b5bfe25e, user_id=b1fa8ccdcf664c43935e7a2f2bb6d0b9, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:00.244607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4fa23-fc31-4525-b377-448e9ad4b00e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:00.255982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1009/2028] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:41:00 2022] PUT /identity/v3/projects/2c4b90c0e9bc46f489dbec90b5bfe25e/users/b1fa8ccdcf664c43935e7a2f2bb6d0b9/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:41:00.267019 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b6793-d3cb-48a1-8332-8efb7b16db97 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:00.267415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b6793-d3cb-48a1-8332-8efb7b16db97 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:00.267578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b6793-d3cb-48a1-8332-8efb7b16db97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:00.297819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ae3b6793-d3cb-48a1-8332-8efb7b16db97 None None] MFA Rules not processed for user `b1fa8ccdcf664c43935e7a2f2bb6d0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:00.299038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ae3b6793-d3cb-48a1-8332-8efb7b16db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:00.370347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1020/2029] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:00.381582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4fa23-fc31-4525-b377-448e9ad4b00e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:00.383374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-14a4fa23-fc31-4525-b377-448e9ad4b00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:00.446270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4fa23-fc31-4525-b377-448e9ad4b00e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:00.450741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb35284-71f9-49d2-acd3-fcaf45bc08bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:00.451390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35284-71f9-49d2-acd3-fcaf45bc08bc service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:00.451672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35284-71f9-49d2-acd3-fcaf45bc08bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:00.451950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35284-71f9-49d2-acd3-fcaf45bc08bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:00.461679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb35284-71f9-49d2-acd3-fcaf45bc08bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:00.464238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb35284-71f9-49d2-acd3-fcaf45bc08bc service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:00.474264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1010/2030] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:41:00.552756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b6793-d3cb-48a1-8332-8efb7b16db97 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:00.556017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb35284-71f9-49d2-acd3-fcaf45bc08bc service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:00.557581 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7eb35284-71f9-49d2-acd3-fcaf45bc08bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:00.563395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b6793-d3cb-48a1-8332-8efb7b16db97 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:00.567154 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ff52-58ce-4466-b255-833df8a8e1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:00.567764 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ff52-58ce-4466-b255-833df8a8e1ee service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:00.568049 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ff52-58ce-4466-b255-833df8a8e1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:00.568325 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ff52-58ce-4466-b255-833df8a8e1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:00.568926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:00.613334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:00.620149 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb35284-71f9-49d2-acd3-fcaf45bc08bc service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:00.623959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764f321-b968-4342-b57e-09be4e0205db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:00.624598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764f321-b968-4342-b57e-09be4e0205db service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:00.624886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764f321-b968-4342-b57e-09be4e0205db service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:00.625161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764f321-b968-4342-b57e-09be4e0205db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:00.627159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3764f321-b968-4342-b57e-09be4e0205db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:00.629975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4ff52-58ce-4466-b255-833df8a8e1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:00.631444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4ff52-58ce-4466-b255-833df8a8e1ee service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:00.638113 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764f321-b968-4342-b57e-09be4e0205db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:00.639579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764f321-b968-4342-b57e-09be4e0205db service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:00.641316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1021/2031] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:41:00.647780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1011/2032] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:41:07.641747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ff52-58ce-4466-b255-833df8a8e1ee service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:07.705831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ff52-58ce-4466-b255-833df8a8e1ee service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:07.710377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:07.711003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:07.711288 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:07.711568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] PATH_INFO: `/v3/users/f929ed89a2cb4023a34bf772a2d2c410` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:07.712710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f929ed89a2cb4023a34bf772a2d2c410)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:07.714649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:07.759780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f929ed89a2cb4023a34bf772a2d2c410'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:07.760359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f929ed89a2cb4023a34bf772a2d2c410'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:07.767824 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f929ed89a2cb4023a34bf772a2d2c410'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:07.774621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f929ed89a2cb4023a34bf772a2d2c410'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:07.775448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f929ed89a2cb4023a34bf772a2d2c410'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:07.792489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1022/2033] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:41:07 2022] DELETE /identity/v3/users/f929ed89a2cb4023a34bf772a2d2c410 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:07.797644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51669327-5e12-4d53-a328-c835f4fbc9b4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:07.798121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51669327-5e12-4d53-a328-c835f4fbc9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:07.798239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51669327-5e12-4d53-a328-c835f4fbc9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:07.817686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-51669327-5e12-4d53-a328-c835f4fbc9b4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:07.818891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-51669327-5e12-4d53-a328-c835f4fbc9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:07.878241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1012/2034] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:07.888152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:07.889662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:07.946627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc1831-8382-450a-9904-92cef40dd606 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:07.950540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407709cd-dbe9-43e5-9242-96ee276c25e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:07.951174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407709cd-dbe9-43e5-9242-96ee276c25e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:07.951454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407709cd-dbe9-43e5-9242-96ee276c25e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:07.951724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407709cd-dbe9-43e5-9242-96ee276c25e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:07.960777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407709cd-dbe9-43e5-9242-96ee276c25e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:07.962206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407709cd-dbe9-43e5-9242-96ee276c25e0 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:07.971587 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1023/2035] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:41:08.237322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51669327-5e12-4d53-a328-c835f4fbc9b4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:08.238802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-51669327-5e12-4d53-a328-c835f4fbc9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:08.260271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51669327-5e12-4d53-a328-c835f4fbc9b4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:08.265218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:08.265887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:08.266168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:08.266438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] PATH_INFO: `/v3/projects/863aaaf03af548ccaaea7065a8db2660` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:08.267539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863aaaf03af548ccaaea7065a8db2660)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:08.269567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:08.317099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863aaaf03af548ccaaea7065a8db2660', 'request_id': 'req-214351fb-03b8-48fa-ad4d-259cee9ff8f7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.325610 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863aaaf03af548ccaaea7065a8db2660', 'request_id': 'req-214351fb-03b8-48fa-ad4d-259cee9ff8f7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.332060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863aaaf03af548ccaaea7065a8db2660', 'request_id': 'req-214351fb-03b8-48fa-ad4d-259cee9ff8f7'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.345148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] The token cache is being invalidate because project 863aaaf03af548ccaaea7065a8db2660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:41:08.345444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.346099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.347627 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1013/2036] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:41:08 2022] DELETE /identity/v3/projects/863aaaf03af548ccaaea7065a8db2660 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:08.351594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407709cd-dbe9-43e5-9242-96ee276c25e0 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:08.358460 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:08.362778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407709cd-dbe9-43e5-9242-96ee276c25e0 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:08.421922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:08.422626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:08.423037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:08.423327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] PATH_INFO: `/v3/users/b1fa8ccdcf664c43935e7a2f2bb6d0b9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:08.424503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fa8ccdcf664c43935e7a2f2bb6d0b9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:08.426456 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:08.481899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fa8ccdcf664c43935e7a2f2bb6d0b9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.482566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fa8ccdcf664c43935e7a2f2bb6d0b9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.494100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fa8ccdcf664c43935e7a2f2bb6d0b9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.503435 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fa8ccdcf664c43935e7a2f2bb6d0b9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.504170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f5c63a06-24de-4023-a0ef-342b2f4d8584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fa8ccdcf664c43935e7a2f2bb6d0b9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.523552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1024/2037] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:41:08 2022] DELETE /identity/v3/users/b1fa8ccdcf664c43935e7a2f2bb6d0b9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:08.803769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:08.805349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:08.821045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214351fb-03b8-48fa-ad4d-259cee9ff8f7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:08.854049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:08.883781 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:08.884415 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:08.884724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:08.885001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] PATH_INFO: `/v3/projects/2c4b90c0e9bc46f489dbec90b5bfe25e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:08.886111 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4b90c0e9bc46f489dbec90b5bfe25e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:08.888029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:08.931670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4b90c0e9bc46f489dbec90b5bfe25e', 'request_id': 'req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.943960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4b90c0e9bc46f489dbec90b5bfe25e', 'request_id': 'req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.950167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4b90c0e9bc46f489dbec90b5bfe25e', 'request_id': 'req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.961127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] The token cache is being invalidate because project 2c4b90c0e9bc46f489dbec90b5bfe25e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:41:08.961411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.962039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e4e6cf29-bc5a-4d6f-87c2-5cd3d3192e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:08.963504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1014/2038] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:41:08 2022] DELETE /identity/v3/projects/2c4b90c0e9bc46f489dbec90b5bfe25e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:08.968953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e315f-a650-43e9-9f73-0820a966c4c7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:08.969433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e315f-a650-43e9-9f73-0820a966c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:08.969680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e315f-a650-43e9-9f73-0820a966c4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:08.990151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d59e315f-a650-43e9-9f73-0820a966c4c7 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:08.991363 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d59e315f-a650-43e9-9f73-0820a966c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:09.050184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1025/2039] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:09.059170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6efc6-999f-4c3a-a71b-affa536d2473 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.059461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6efc6-999f-4c3a-a71b-affa536d2473 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.059740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6efc6-999f-4c3a-a71b-affa536d2473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.079803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1af6efc6-999f-4c3a-a71b-affa536d2473 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:09.081043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1af6efc6-999f-4c3a-a71b-affa536d2473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:09.088958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1015/2040] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:09.093954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e315f-a650-43e9-9f73-0820a966c4c7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.103521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e315f-a650-43e9-9f73-0820a966c4c7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.109927 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22212792-45be-4c2e-828a-d6c979d3470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.110541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22212792-45be-4c2e-828a-d6c979d3470e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.110821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22212792-45be-4c2e-828a-d6c979d3470e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.111095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22212792-45be-4c2e-828a-d6c979d3470e admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.111745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22212792-45be-4c2e-828a-d6c979d3470e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:41:09.112405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22212792-45be-4c2e-828a-d6c979d3470e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.113668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22212792-45be-4c2e-828a-d6c979d3470e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.128145 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1026/2041] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:41:09.129872 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6efc6-999f-4c3a-a71b-affa536d2473 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.139690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6efc6-999f-4c3a-a71b-affa536d2473 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.144390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aee184-f556-4c89-90de-a9c5aa578b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.145027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee184-f556-4c89-90de-a9c5aa578b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.145311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee184-f556-4c89-90de-a9c5aa578b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.145617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee184-f556-4c89-90de-a9c5aa578b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.146261 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aee184-f556-4c89-90de-a9c5aa578b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.148185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aee184-f556-4c89-90de-a9c5aa578b03 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.180770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1016/2042] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:41:09 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:41:09.181916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22212792-45be-4c2e-828a-d6c979d3470e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.192055 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22212792-45be-4c2e-828a-d6c979d3470e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.199857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:09.252639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec39e8-5286-4afa-831c-84619ac849d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.253561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec39e8-5286-4afa-831c-84619ac849d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.253837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec39e8-5286-4afa-831c-84619ac849d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.254103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec39e8-5286-4afa-831c-84619ac849d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.254727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec39e8-5286-4afa-831c-84619ac849d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.256651 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec39e8-5286-4afa-831c-84619ac849d0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.282329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1027/2043] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:41:09 2022] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:41:09.283538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aee184-f556-4c89-90de-a9c5aa578b03 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.294321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aee184-f556-4c89-90de-a9c5aa578b03 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.298905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907d48-200d-4af0-a825-d0b3ae74b257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.299498 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907d48-200d-4af0-a825-d0b3ae74b257 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.299777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907d48-200d-4af0-a825-d0b3ae74b257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.300048 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907d48-200d-4af0-a825-d0b3ae74b257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.300757 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d907d48-200d-4af0-a825-d0b3ae74b257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.302291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d907d48-200d-4af0-a825-d0b3ae74b257 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.312171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1017/2044] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:41:09.316123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec39e8-5286-4afa-831c-84619ac849d0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.326490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec39e8-5286-4afa-831c-84619ac849d0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.331090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357efc6-2138-4daf-aea0-27fd127a1120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.331667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357efc6-2138-4daf-aea0-27fd127a1120 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.331966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357efc6-2138-4daf-aea0-27fd127a1120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.332255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357efc6-2138-4daf-aea0-27fd127a1120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.332918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357efc6-2138-4daf-aea0-27fd127a1120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.334600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357efc6-2138-4daf-aea0-27fd127a1120 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.345891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1028/2045] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:41:09.350215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907d48-200d-4af0-a825-d0b3ae74b257 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.360765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907d48-200d-4af0-a825-d0b3ae74b257 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.365364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca58f6-6271-4a8d-a70c-0b7b55e61b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.366007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca58f6-6271-4a8d-a70c-0b7b55e61b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.366283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca58f6-6271-4a8d-a70c-0b7b55e61b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.366553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca58f6-6271-4a8d-a70c-0b7b55e61b50 admin admin] PATH_INFO: `/v3/projects/aa06c0edeba94d24ad765ffa940e1609/users/36fd8843f46644889f2d8d78f1cafc75/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.381392 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca58f6-6271-4a8d-a70c-0b7b55e61b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa06c0edeba94d24ad765ffa940e1609, user_id=36fd8843f46644889f2d8d78f1cafc75, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.384139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca58f6-6271-4a8d-a70c-0b7b55e61b50 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.397053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1018/2046] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:41:09 2022] PUT /identity/v3/projects/aa06c0edeba94d24ad765ffa940e1609/users/36fd8843f46644889f2d8d78f1cafc75/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:09.408024 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa5eed-6703-451b-9789-9e720ec9ebd2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.408309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa5eed-6703-451b-9789-9e720ec9ebd2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.408617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa5eed-6703-451b-9789-9e720ec9ebd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.435560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f5aa5eed-6703-451b-9789-9e720ec9ebd2 None None] MFA Rules not processed for user `36fd8843f46644889f2d8d78f1cafc75`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:09.436791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f5aa5eed-6703-451b-9789-9e720ec9ebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:09.500136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1029/2047] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:41:09.504726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca58f6-6271-4a8d-a70c-0b7b55e61b50 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.564368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca58f6-6271-4a8d-a70c-0b7b55e61b50 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.568881 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42376-2c15-404d-90ae-2cb3f87de1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.569478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42376-2c15-404d-90ae-2cb3f87de1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.569756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42376-2c15-404d-90ae-2cb3f87de1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.570027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42376-2c15-404d-90ae-2cb3f87de1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.570641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42376-2c15-404d-90ae-2cb3f87de1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.572565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42376-2c15-404d-90ae-2cb3f87de1d8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.577030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:09.600709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1019/2048] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:41:09 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:41:09.604638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa5eed-6703-451b-9789-9e720ec9ebd2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.615876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa5eed-6703-451b-9789-9e720ec9ebd2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.670588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40396c-0dfe-4282-8a0b-86e785c0c400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.671193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40396c-0dfe-4282-8a0b-86e785c0c400 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.671474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40396c-0dfe-4282-8a0b-86e785c0c400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.671746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40396c-0dfe-4282-8a0b-86e785c0c400 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.672380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40396c-0dfe-4282-8a0b-86e785c0c400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.674340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40396c-0dfe-4282-8a0b-86e785c0c400 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.694896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1030/2049] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:41:09 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:41:09.698906 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42376-2c15-404d-90ae-2cb3f87de1d8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.709364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42376-2c15-404d-90ae-2cb3f87de1d8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.714083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867f22-5e87-4ec8-a770-c7dfb82371cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.715258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867f22-5e87-4ec8-a770-c7dfb82371cf admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.715538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867f22-5e87-4ec8-a770-c7dfb82371cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.715903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867f22-5e87-4ec8-a770-c7dfb82371cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.716722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867f22-5e87-4ec8-a770-c7dfb82371cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.718523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867f22-5e87-4ec8-a770-c7dfb82371cf admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.728817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1020/2050] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:41:09.733580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40396c-0dfe-4282-8a0b-86e785c0c400 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.743622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40396c-0dfe-4282-8a0b-86e785c0c400 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.748219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e77249-5726-4103-af37-f4b60af94486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.748883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e77249-5726-4103-af37-f4b60af94486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.749160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e77249-5726-4103-af37-f4b60af94486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.749428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e77249-5726-4103-af37-f4b60af94486 admin admin] PATH_INFO: `/v3/projects/a6b3cde2eff74c6ab4fa07459a6281fb/users/7c9d660e14ba4affa9083a100d559420/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.752369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:09.765753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e77249-5726-4103-af37-f4b60af94486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b3cde2eff74c6ab4fa07459a6281fb, user_id=7c9d660e14ba4affa9083a100d559420, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.768411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e77249-5726-4103-af37-f4b60af94486 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.781724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1031/2051] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:41:09 2022] PUT /identity/v3/projects/a6b3cde2eff74c6ab4fa07459a6281fb/users/7c9d660e14ba4affa9083a100d559420/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:09.785551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867f22-5e87-4ec8-a770-c7dfb82371cf admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.796079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867f22-5e87-4ec8-a770-c7dfb82371cf admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.853919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b92b9c-cb05-4c1e-9232-46d8212398b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.854622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b92b9c-cb05-4c1e-9232-46d8212398b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.854729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b92b9c-cb05-4c1e-9232-46d8212398b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.854972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b92b9c-cb05-4c1e-9232-46d8212398b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.856144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b92b9c-cb05-4c1e-9232-46d8212398b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.857790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b92b9c-cb05-4c1e-9232-46d8212398b0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.868008 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1021/2052] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:41:09.872355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e77249-5726-4103-af37-f4b60af94486 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:09.882731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e77249-5726-4103-af37-f4b60af94486 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:09.887380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed86bdb-85cb-4435-af9e-281ca7c1fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:09.888720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed86bdb-85cb-4435-af9e-281ca7c1fe2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.889002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed86bdb-85cb-4435-af9e-281ca7c1fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.889268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed86bdb-85cb-4435-af9e-281ca7c1fe2a admin admin] PATH_INFO: `/v3/projects/a6b3cde2eff74c6ab4fa07459a6281fb/users/7c9d660e14ba4affa9083a100d559420/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.891160 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed86bdb-85cb-4435-af9e-281ca7c1fe2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b3cde2eff74c6ab4fa07459a6281fb, user_id=7c9d660e14ba4affa9083a100d559420, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:09.893795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed86bdb-85cb-4435-af9e-281ca7c1fe2a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:09.904410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1032/2053] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:41:09 2022] PUT /identity/v3/projects/a6b3cde2eff74c6ab4fa07459a6281fb/users/7c9d660e14ba4affa9083a100d559420/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:09.914367 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ec7f-04bd-4e8a-a362-e14abff5eba0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:09.914681 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ec7f-04bd-4e8a-a362-e14abff5eba0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:09.914961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ec7f-04bd-4e8a-a362-e14abff5eba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:09.943091 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7f14ec7f-04bd-4e8a-a362-e14abff5eba0 None None] MFA Rules not processed for user `7c9d660e14ba4affa9083a100d559420`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:09.944303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7f14ec7f-04bd-4e8a-a362-e14abff5eba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:10.012386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1022/2054] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:10.024299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed86bdb-85cb-4435-af9e-281ca7c1fe2a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:10.026152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0ed86bdb-85cb-4435-af9e-281ca7c1fe2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:10.086322 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed86bdb-85cb-4435-af9e-281ca7c1fe2a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:10.090878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f40f9-59a7-47e5-b744-91b820023369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:10.091486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f40f9-59a7-47e5-b744-91b820023369 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:10.091769 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f40f9-59a7-47e5-b744-91b820023369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:10.092046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f40f9-59a7-47e5-b744-91b820023369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:10.101020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f40f9-59a7-47e5-b744-91b820023369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:10.102436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f40f9-59a7-47e5-b744-91b820023369 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:10.112597 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1033/2055] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:41:10.188815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ec7f-04bd-4e8a-a362-e14abff5eba0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:10.198338 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ec7f-04bd-4e8a-a362-e14abff5eba0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:10.202555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701b58b-a28a-43cd-a76c-c4c336453af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:10.203152 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b58b-a28a-43cd-a76c-c4c336453af0 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:10.203430 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b58b-a28a-43cd-a76c-c4c336453af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:10.203702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b58b-a28a-43cd-a76c-c4c336453af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:10.258169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:10.263486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701b58b-a28a-43cd-a76c-c4c336453af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:10.265452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701b58b-a28a-43cd-a76c-c4c336453af0 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:10.274293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1023/2056] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:41:20.108197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=37,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:20.270357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:25.386817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f40f9-59a7-47e5-b744-91b820023369 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:25.448026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f40f9-59a7-47e5-b744-91b820023369 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:25.452691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:25.453308 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:25.453626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:25.453896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] PATH_INFO: `/v3/users/36fd8843f46644889f2d8d78f1cafc75` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:25.455039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fd8843f46644889f2d8d78f1cafc75)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:25.456978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:25.502999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fd8843f46644889f2d8d78f1cafc75'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:25.503650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fd8843f46644889f2d8d78f1cafc75'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:25.510401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fd8843f46644889f2d8d78f1cafc75'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:25.517584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fd8843f46644889f2d8d78f1cafc75'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:25.518257 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fd8843f46644889f2d8d78f1cafc75'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:25.535605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1034/2057] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:41:25 2022] DELETE /identity/v3/users/36fd8843f46644889f2d8d78f1cafc75 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:25.540024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fcaaa-cd3c-4072-9a3a-cacd3a0960a4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:25.540630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fcaaa-cd3c-4072-9a3a-cacd3a0960a4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:25.540630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fcaaa-cd3c-4072-9a3a-cacd3a0960a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:25.559828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a09fcaaa-cd3c-4072-9a3a-cacd3a0960a4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:25.560989 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a09fcaaa-cd3c-4072-9a3a-cacd3a0960a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:25.621498 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1024/2058] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:25.631183 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:25.632664 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:25.691056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a86183-e259-46ca-840d-9c8b9e7860cb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:25.695150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f025b-12ee-4019-a022-73d7994caf3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:25.695747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f025b-12ee-4019-a022-73d7994caf3a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:25.696023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f025b-12ee-4019-a022-73d7994caf3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:25.696291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f025b-12ee-4019-a022-73d7994caf3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:25.705355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f025b-12ee-4019-a022-73d7994caf3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:25.706795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f025b-12ee-4019-a022-73d7994caf3a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:25.717285 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1035/2059] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:41:25.985453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fcaaa-cd3c-4072-9a3a-cacd3a0960a4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:25.986884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a09fcaaa-cd3c-4072-9a3a-cacd3a0960a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:26.007122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fcaaa-cd3c-4072-9a3a-cacd3a0960a4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:26.013185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:26.013964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:26.014362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:26.014761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] PATH_INFO: `/v3/projects/aa06c0edeba94d24ad765ffa940e1609` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:26.016001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa06c0edeba94d24ad765ffa940e1609)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:26.017927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:26.069121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa06c0edeba94d24ad765ffa940e1609', 'request_id': 'req-eb8819fc-b241-438e-9690-2b4f8d703e7a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.076876 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa06c0edeba94d24ad765ffa940e1609', 'request_id': 'req-eb8819fc-b241-438e-9690-2b4f8d703e7a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.082605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa06c0edeba94d24ad765ffa940e1609', 'request_id': 'req-eb8819fc-b241-438e-9690-2b4f8d703e7a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.094868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] The token cache is being invalidate because project aa06c0edeba94d24ad765ffa940e1609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:41:26.095158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.095791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.097334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1025/2060] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:41:25 2022] DELETE /identity/v3/projects/aa06c0edeba94d24ad765ffa940e1609 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:26.101329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f025b-12ee-4019-a022-73d7994caf3a service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:26.111337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f025b-12ee-4019-a022-73d7994caf3a service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:26.128896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:26.170398 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:26.171040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:26.171316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:26.171586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] PATH_INFO: `/v3/users/7c9d660e14ba4affa9083a100d559420` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:26.172710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9d660e14ba4affa9083a100d559420)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:26.174605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:26.218756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9d660e14ba4affa9083a100d559420'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.219418 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9d660e14ba4affa9083a100d559420'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.226259 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9d660e14ba4affa9083a100d559420'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.232987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9d660e14ba4affa9083a100d559420'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.233630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-501bada9-4afd-4d80-8f2b-2a227e8b6010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9d660e14ba4affa9083a100d559420'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.251313 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1036/2061] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:41:26 2022] DELETE /identity/v3/users/7c9d660e14ba4affa9083a100d559420 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:26.517999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:26.519885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:26.536210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8819fc-b241-438e-9690-2b4f8d703e7a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:26.595548 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:26.596184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:26.596370 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:26.596676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] PATH_INFO: `/v3/projects/a6b3cde2eff74c6ab4fa07459a6281fb` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:26.597790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b3cde2eff74c6ab4fa07459a6281fb)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:26.599690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:26.630723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:26.647648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b3cde2eff74c6ab4fa07459a6281fb', 'request_id': 'req-b2034695-037c-4b33-9bb9-13dcd4739be9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.654933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b3cde2eff74c6ab4fa07459a6281fb', 'request_id': 'req-b2034695-037c-4b33-9bb9-13dcd4739be9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.660547 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b3cde2eff74c6ab4fa07459a6281fb', 'request_id': 'req-b2034695-037c-4b33-9bb9-13dcd4739be9'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.672164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] The token cache is being invalidate because project a6b3cde2eff74c6ab4fa07459a6281fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:41:26.672472 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.673559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-b2034695-037c-4b33-9bb9-13dcd4739be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:26.675028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1026/2062] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:41:26 2022] DELETE /identity/v3/projects/a6b3cde2eff74c6ab4fa07459a6281fb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:26.679861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e5e8f-bc52-4c89-9d24-4f52a4e7d4ef None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:26.680320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e5e8f-bc52-4c89-9d24-4f52a4e7d4ef None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:26.680441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e5e8f-bc52-4c89-9d24-4f52a4e7d4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:26.700490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-184e5e8f-bc52-4c89-9d24-4f52a4e7d4ef None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:26.701702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-184e5e8f-bc52-4c89-9d24-4f52a4e7d4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:26.760682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1037/2063] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:26.768597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54571412-b291-4579-9ea7-c77c5d673bf6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:26.768883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54571412-b291-4579-9ea7-c77c5d673bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:26.769156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54571412-b291-4579-9ea7-c77c5d673bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:26.789294 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-54571412-b291-4579-9ea7-c77c5d673bf6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:26.790493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-54571412-b291-4579-9ea7-c77c5d673bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:26.803844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1027/2064] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:26.805716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e5e8f-bc52-4c89-9d24-4f52a4e7d4ef None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:26.818457 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e5e8f-bc52-4c89-9d24-4f52a4e7d4ef None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:26.823590 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0ffa0-c322-4b1d-b94e-9c6eeb21c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:26.824214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ffa0-c322-4b1d-b94e-9c6eeb21c42d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:26.825158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ffa0-c322-4b1d-b94e-9c6eeb21c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:26.825533 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ffa0-c322-4b1d-b94e-9c6eeb21c42d admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:26.826185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0ffa0-c322-4b1d-b94e-9c6eeb21c42d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:41:26.826553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0ffa0-c322-4b1d-b94e-9c6eeb21c42d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:26.828221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0ffa0-c322-4b1d-b94e-9c6eeb21c42d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:26.840474 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1038/2065] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:41:26.844880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54571412-b291-4579-9ea7-c77c5d673bf6 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:26.854238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54571412-b291-4579-9ea7-c77c5d673bf6 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:26.859681 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640134d-097a-4352-87ef-fa7456578a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:26.860271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640134d-097a-4352-87ef-fa7456578a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:26.860607 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640134d-097a-4352-87ef-fa7456578a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:26.860880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640134d-097a-4352-87ef-fa7456578a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:26.861511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640134d-097a-4352-87ef-fa7456578a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:26.863381 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640134d-097a-4352-87ef-fa7456578a9a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:26.890771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1028/2066] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:41:26 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:41:26.894722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0ffa0-c322-4b1d-b94e-9c6eeb21c42d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:26.905335 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0ffa0-c322-4b1d-b94e-9c6eeb21c42d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:26.931142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:26.962696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c62a-2131-4069-b567-21ccdacca3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:26.963292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c62a-2131-4069-b567-21ccdacca3cb admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:26.963570 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c62a-2131-4069-b567-21ccdacca3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:26.963842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c62a-2131-4069-b567-21ccdacca3cb admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:26.964480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0c62a-2131-4069-b567-21ccdacca3cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:26.967066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0c62a-2131-4069-b567-21ccdacca3cb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:26.987958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1039/2067] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:41:26 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:41:26.992271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640134d-097a-4352-87ef-fa7456578a9a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:27.002630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640134d-097a-4352-87ef-fa7456578a9a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:27.007189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24d803-28f1-455e-9631-88a22a425b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:27.007778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24d803-28f1-455e-9631-88a22a425b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.008062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24d803-28f1-455e-9631-88a22a425b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.008335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24d803-28f1-455e-9631-88a22a425b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.009019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24d803-28f1-455e-9631-88a22a425b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:27.010611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24d803-28f1-455e-9631-88a22a425b99 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:27.020541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1029/2068] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:41:27.024351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c62a-2131-4069-b567-21ccdacca3cb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:27.034672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c62a-2131-4069-b567-21ccdacca3cb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:27.039191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740fab2-446a-4cf9-aefe-e56e0d567aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:27.039778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fab2-446a-4cf9-aefe-e56e0d567aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.040057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fab2-446a-4cf9-aefe-e56e0d567aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.040330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fab2-446a-4cf9-aefe-e56e0d567aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.040998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740fab2-446a-4cf9-aefe-e56e0d567aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:27.042566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740fab2-446a-4cf9-aefe-e56e0d567aa9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:27.055595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1040/2069] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:41:27.060535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24d803-28f1-455e-9631-88a22a425b99 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:27.070499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24d803-28f1-455e-9631-88a22a425b99 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:27.075792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114114a-a44f-4716-a0f7-f3f94aba7892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:27.076434 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114114a-a44f-4716-a0f7-f3f94aba7892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.076751 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114114a-a44f-4716-a0f7-f3f94aba7892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.077027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114114a-a44f-4716-a0f7-f3f94aba7892 admin admin] PATH_INFO: `/v3/projects/0b254e663f25496c8562e0bcdb14f3e5/users/f68ed050b5ee4f40b9a8406ed0c19bc5/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.092639 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114114a-a44f-4716-a0f7-f3f94aba7892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b254e663f25496c8562e0bcdb14f3e5, user_id=f68ed050b5ee4f40b9a8406ed0c19bc5, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:27.095311 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114114a-a44f-4716-a0f7-f3f94aba7892 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:27.108648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1030/2070] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:41:27 2022] PUT /identity/v3/projects/0b254e663f25496c8562e0bcdb14f3e5/users/f68ed050b5ee4f40b9a8406ed0c19bc5/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:27.118971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038681-d98f-4f9d-b400-c936c9cdf48d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.119260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038681-d98f-4f9d-b400-c936c9cdf48d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.119532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038681-d98f-4f9d-b400-c936c9cdf48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.147805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4e038681-d98f-4f9d-b400-c936c9cdf48d None None] MFA Rules not processed for user `f68ed050b5ee4f40b9a8406ed0c19bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:27.149043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4e038681-d98f-4f9d-b400-c936c9cdf48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:27.211774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1041/2071] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:27.216322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114114a-a44f-4716-a0f7-f3f94aba7892 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:27.276214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114114a-a44f-4716-a0f7-f3f94aba7892 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:27.281267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde589c4-d1be-4ec0-a149-a6eed34d6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:27.281867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde589c4-d1be-4ec0-a149-a6eed34d6157 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.282148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde589c4-d1be-4ec0-a149-a6eed34d6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.282420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde589c4-d1be-4ec0-a149-a6eed34d6157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.283045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde589c4-d1be-4ec0-a149-a6eed34d6157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:27.285007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde589c4-d1be-4ec0-a149-a6eed34d6157 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:27.312059 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1031/2072] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:41:27 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:41:27.316144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e038681-d98f-4f9d-b400-c936c9cdf48d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:27.326662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e038681-d98f-4f9d-b400-c936c9cdf48d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:27.382184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b016a7f-04b3-43ad-855c-9598dfc905d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:27.382718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b016a7f-04b3-43ad-855c-9598dfc905d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.382996 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b016a7f-04b3-43ad-855c-9598dfc905d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.383265 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b016a7f-04b3-43ad-855c-9598dfc905d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.383874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b016a7f-04b3-43ad-855c-9598dfc905d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:27.385795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b016a7f-04b3-43ad-855c-9598dfc905d1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:27.406451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1042/2073] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:41:27 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:41:27.410259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde589c4-d1be-4ec0-a149-a6eed34d6157 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:27.421194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde589c4-d1be-4ec0-a149-a6eed34d6157 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:27.425762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f682e7-c076-460a-a205-b4663ec88247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:27.426350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f682e7-c076-460a-a205-b4663ec88247 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.426627 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f682e7-c076-460a-a205-b4663ec88247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.426896 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f682e7-c076-460a-a205-b4663ec88247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.427526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f682e7-c076-460a-a205-b4663ec88247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:27.429169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f682e7-c076-460a-a205-b4663ec88247 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:27.440084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1032/2074] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:41:27.444070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b016a7f-04b3-43ad-855c-9598dfc905d1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:27.454074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b016a7f-04b3-43ad-855c-9598dfc905d1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:27.458642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d55d39-0fcb-48b8-86fc-640134c773d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:27.459281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55d39-0fcb-48b8-86fc-640134c773d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.459563 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55d39-0fcb-48b8-86fc-640134c773d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.459836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55d39-0fcb-48b8-86fc-640134c773d3 admin admin] PATH_INFO: `/v3/projects/350a3b202c884cfba1c11c16f66fe209/users/06a149329dc540d0a2e9cbc4ea660123/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.474688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d55d39-0fcb-48b8-86fc-640134c773d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350a3b202c884cfba1c11c16f66fe209, user_id=06a149329dc540d0a2e9cbc4ea660123, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:27.477376 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d55d39-0fcb-48b8-86fc-640134c773d3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:27.491244 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1043/2075] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:41:27 2022] PUT /identity/v3/projects/350a3b202c884cfba1c11c16f66fe209/users/06a149329dc540d0a2e9cbc4ea660123/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:27.495118 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f682e7-c076-460a-a205-b4663ec88247 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:27.505616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f682e7-c076-460a-a205-b4663ec88247 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:27.524832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:27.563783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30984d2-08c5-4ca3-8e2f-7504bf79d160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:27.564388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30984d2-08c5-4ca3-8e2f-7504bf79d160 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.564709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30984d2-08c5-4ca3-8e2f-7504bf79d160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.564985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30984d2-08c5-4ca3-8e2f-7504bf79d160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.565629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30984d2-08c5-4ca3-8e2f-7504bf79d160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:27.567224 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30984d2-08c5-4ca3-8e2f-7504bf79d160 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:27.577016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1033/2076] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:41:27.581049 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d55d39-0fcb-48b8-86fc-640134c773d3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:27.586403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:27.592979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d55d39-0fcb-48b8-86fc-640134c773d3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:27.598103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7aee6-2809-40f4-a74f-c8daf9a9d54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:27.598775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7aee6-2809-40f4-a74f-c8daf9a9d54c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.599059 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7aee6-2809-40f4-a74f-c8daf9a9d54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.599332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7aee6-2809-40f4-a74f-c8daf9a9d54c admin admin] PATH_INFO: `/v3/projects/350a3b202c884cfba1c11c16f66fe209/users/06a149329dc540d0a2e9cbc4ea660123/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.601311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7aee6-2809-40f4-a74f-c8daf9a9d54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=350a3b202c884cfba1c11c16f66fe209, user_id=06a149329dc540d0a2e9cbc4ea660123, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:27.603932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7aee6-2809-40f4-a74f-c8daf9a9d54c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:27.614954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1044/2077] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:41:27 2022] PUT /identity/v3/projects/350a3b202c884cfba1c11c16f66fe209/users/06a149329dc540d0a2e9cbc4ea660123/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:27.626693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df9353-12c3-4e71-a565-f4aa5780cf64 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.627164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df9353-12c3-4e71-a565-f4aa5780cf64 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.627257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df9353-12c3-4e71-a565-f4aa5780cf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.656516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d9df9353-12c3-4e71-a565-f4aa5780cf64 None None] MFA Rules not processed for user `06a149329dc540d0a2e9cbc4ea660123`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:27.657648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d9df9353-12c3-4e71-a565-f4aa5780cf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:27.725566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1034/2078] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:27.737738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7aee6-2809-40f4-a74f-c8daf9a9d54c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:27.739500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b2a7aee6-2809-40f4-a74f-c8daf9a9d54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:27.797169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7aee6-2809-40f4-a74f-c8daf9a9d54c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:27.800896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402cec5-5056-43f2-9ec4-0bb199e0c4fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:27.801502 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402cec5-5056-43f2-9ec4-0bb199e0c4fa service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:27.801809 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402cec5-5056-43f2-9ec4-0bb199e0c4fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:27.802083 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402cec5-5056-43f2-9ec4-0bb199e0c4fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:27.861899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402cec5-5056-43f2-9ec4-0bb199e0c4fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:27.863310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402cec5-5056-43f2-9ec4-0bb199e0c4fa service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:27.872060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1045/2079] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:41:30.530341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df9353-12c3-4e71-a565-f4aa5780cf64 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:30.541543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df9353-12c3-4e71-a565-f4aa5780cf64 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:30.545295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961ba24-1c3b-4814-a963-6d2c08b4742a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:30.545962 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961ba24-1c3b-4814-a963-6d2c08b4742a service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:30.546241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961ba24-1c3b-4814-a963-6d2c08b4742a service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:30.546509 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961ba24-1c3b-4814-a963-6d2c08b4742a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:30.556000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961ba24-1c3b-4814-a963-6d2c08b4742a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:30.557558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961ba24-1c3b-4814-a963-6d2c08b4742a service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:30.567745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1035/2080] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:41:37.868158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:37.893599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8304f7-b330-4c82-9813-e151cd04f5a5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:37.893888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8304f7-b330-4c82-9813-e151cd04f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:37.894171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8304f7-b330-4c82-9813-e151cd04f5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:37.913399 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8f8304f7-b330-4c82-9813-e151cd04f5a5 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:37.914595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8f8304f7-b330-4c82-9813-e151cd04f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:37.968916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1046/2081] 10.222.0.20 () {58 vars in 967 bytes} [Wed Nov 2 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:41:38.014971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961ba24-1c3b-4814-a963-6d2c08b4742a service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:38.016413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f961ba24-1c3b-4814-a963-6d2c08b4742a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:38.085406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961ba24-1c3b-4814-a963-6d2c08b4742a service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:38.090810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ceeed-e886-4aef-b221-d13bfd64b26c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:38.091236 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ceeed-e886-4aef-b221-d13bfd64b26c service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:38.091516 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ceeed-e886-4aef-b221-d13bfd64b26c service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:38.091845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ceeed-e886-4aef-b221-d13bfd64b26c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:38.100079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ceeed-e886-4aef-b221-d13bfd64b26c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:38.101686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ceeed-e886-4aef-b221-d13bfd64b26c service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:38.113170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1036/2082] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:41:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:41:41.952215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8304f7-b330-4c82-9813-e151cd04f5a5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:41.954085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8f8304f7-b330-4c82-9813-e151cd04f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:42.045319 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8304f7-b330-4c82-9813-e151cd04f5a5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:42.050960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ecd1f-470c-49dc-a58f-4f1d2702755d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:42.051759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ecd1f-470c-49dc-a58f-4f1d2702755d service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:42.052224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ecd1f-470c-49dc-a58f-4f1d2702755d service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:42.055041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ecd1f-470c-49dc-a58f-4f1d2702755d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:42.057118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a09ecd1f-470c-49dc-a58f-4f1d2702755d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:42.069714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ecd1f-470c-49dc-a58f-4f1d2702755d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:42.071277 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ecd1f-470c-49dc-a58f-4f1d2702755d service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:42.081454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1047/2083] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:41:43.463423 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ceeed-e886-4aef-b221-d13bfd64b26c service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:43.511115 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:43.560693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ceeed-e886-4aef-b221-d13bfd64b26c service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:43.565564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:43.566374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:43.566684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:43.567120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] PATH_INFO: `/v3/users/f68ed050b5ee4f40b9a8406ed0c19bc5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:43.568316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68ed050b5ee4f40b9a8406ed0c19bc5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:43.570385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:43.625559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68ed050b5ee4f40b9a8406ed0c19bc5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:43.626246 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68ed050b5ee4f40b9a8406ed0c19bc5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:43.634985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68ed050b5ee4f40b9a8406ed0c19bc5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:43.635753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68ed050b5ee4f40b9a8406ed0c19bc5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:43.652331 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68ed050b5ee4f40b9a8406ed0c19bc5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:43.669106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1037/2084] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:41:43 2022] DELETE /identity/v3/users/f68ed050b5ee4f40b9a8406ed0c19bc5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:43.673945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26971381-78fa-42da-9635-f3a0dc9faf2a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:43.674742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26971381-78fa-42da-9635-f3a0dc9faf2a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:43.675027 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26971381-78fa-42da-9635-f3a0dc9faf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:43.697050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-26971381-78fa-42da-9635-f3a0dc9faf2a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:43.698447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-26971381-78fa-42da-9635-f3a0dc9faf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:43.786796 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1048/2085] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:41:43.799528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:43.801020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:43.879183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f41199-b660-43ec-acdd-c5caf75051e0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:43.883860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7542fd-792c-4b2e-b55a-a00ed29cc24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:43.884522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7542fd-792c-4b2e-b55a-a00ed29cc24f service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:43.884818 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7542fd-792c-4b2e-b55a-a00ed29cc24f service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:43.885234 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7542fd-792c-4b2e-b55a-a00ed29cc24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:43.897260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7542fd-792c-4b2e-b55a-a00ed29cc24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:43.898559 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7542fd-792c-4b2e-b55a-a00ed29cc24f service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:43.915538 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1038/2086] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:41:44.345598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26971381-78fa-42da-9635-f3a0dc9faf2a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:44.347039 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-26971381-78fa-42da-9635-f3a0dc9faf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:44.366895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26971381-78fa-42da-9635-f3a0dc9faf2a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:44.373701 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:44.374357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:44.374639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:44.374911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] PATH_INFO: `/v3/projects/0b254e663f25496c8562e0bcdb14f3e5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:44.383437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b254e663f25496c8562e0bcdb14f3e5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:44.385464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:44.422294 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:44.436135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b254e663f25496c8562e0bcdb14f3e5', 'request_id': 'req-beba60de-4eeb-41f4-9563-3a65e1ae8086'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:44.441744 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b254e663f25496c8562e0bcdb14f3e5', 'request_id': 'req-beba60de-4eeb-41f4-9563-3a65e1ae8086'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:44.448827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b254e663f25496c8562e0bcdb14f3e5', 'request_id': 'req-beba60de-4eeb-41f4-9563-3a65e1ae8086'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:44.461588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] The token cache is being invalidate because project 0b254e663f25496c8562e0bcdb14f3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:41:44.461877 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:44.462496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:44.464106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1049/2087] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:41:44 2022] DELETE /identity/v3/projects/0b254e663f25496c8562e0bcdb14f3e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:44.468731 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7542fd-792c-4b2e-b55a-a00ed29cc24f service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:44.478146 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7542fd-792c-4b2e-b55a-a00ed29cc24f service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:44.520377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:44.539429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:44.540167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:44.540322 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:44.540646 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] PATH_INFO: `/v3/users/06a149329dc540d0a2e9cbc4ea660123` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:44.541844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a149329dc540d0a2e9cbc4ea660123)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:44.543944 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:44.620202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a149329dc540d0a2e9cbc4ea660123'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:44.621754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a149329dc540d0a2e9cbc4ea660123'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:44.638810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a149329dc540d0a2e9cbc4ea660123'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:44.639821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a149329dc540d0a2e9cbc4ea660123'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:44.677317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2beabd6b-ef49-4492-8c57-c518a76a78fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a149329dc540d0a2e9cbc4ea660123'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:44.698224 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1039/2088] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:41:44 2022] DELETE /identity/v3/users/06a149329dc540d0a2e9cbc4ea660123 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:45.098752 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:45.101632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:45.123668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba60de-4eeb-41f4-9563-3a65e1ae8086 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:45.199005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:45.199679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:45.200115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:45.200388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] PATH_INFO: `/v3/projects/350a3b202c884cfba1c11c16f66fe209` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:45.201714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350a3b202c884cfba1c11c16f66fe209)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:45.203691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:45.265690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350a3b202c884cfba1c11c16f66fe209', 'request_id': 'req-bb683581-0206-4e38-a3b3-33279aaeff42'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:45.272912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350a3b202c884cfba1c11c16f66fe209', 'request_id': 'req-bb683581-0206-4e38-a3b3-33279aaeff42'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:45.281367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350a3b202c884cfba1c11c16f66fe209', 'request_id': 'req-bb683581-0206-4e38-a3b3-33279aaeff42'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:45.303135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] The token cache is being invalidate because project 350a3b202c884cfba1c11c16f66fe209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:41:45.303587 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:45.304681 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bb683581-0206-4e38-a3b3-33279aaeff42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:45.306487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1050/2089] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:41:45 2022] DELETE /identity/v3/projects/350a3b202c884cfba1c11c16f66fe209 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:45.312450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d387bc-b20a-44d1-98ec-42a2410eff96 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:45.312844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d387bc-b20a-44d1-98ec-42a2410eff96 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:45.313190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d387bc-b20a-44d1-98ec-42a2410eff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:45.335671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e2d387bc-b20a-44d1-98ec-42a2410eff96 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:45.337050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e2d387bc-b20a-44d1-98ec-42a2410eff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:45.436665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1040/2090] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:41:45.444776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab64eb8-04d1-4a1f-8da9-f39bac1d8b6f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:45.445020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab64eb8-04d1-4a1f-8da9-f39bac1d8b6f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:45.445453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab64eb8-04d1-4a1f-8da9-f39bac1d8b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:45.476841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0ab64eb8-04d1-4a1f-8da9-f39bac1d8b6f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:45.478199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0ab64eb8-04d1-4a1f-8da9-f39bac1d8b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:45.504520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1051/2091] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:45.506633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d387bc-b20a-44d1-98ec-42a2410eff96 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:45.518468 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d387bc-b20a-44d1-98ec-42a2410eff96 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:45.524691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd290c4-9221-407d-8683-b9709b17af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:45.525316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd290c4-9221-407d-8683-b9709b17af00 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:45.525601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd290c4-9221-407d-8683-b9709b17af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:45.525909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd290c4-9221-407d-8683-b9709b17af00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:45.526594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd290c4-9221-407d-8683-b9709b17af00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:41:45.526867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd290c4-9221-407d-8683-b9709b17af00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:45.529463 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd290c4-9221-407d-8683-b9709b17af00 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:45.541269 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1041/2092] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:41:45.546299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab64eb8-04d1-4a1f-8da9-f39bac1d8b6f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:45.555663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab64eb8-04d1-4a1f-8da9-f39bac1d8b6f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:45.563961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e8dee-8986-4798-822d-d74c9e525a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:45.564600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e8dee-8986-4798-822d-d74c9e525a62 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:45.564883 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e8dee-8986-4798-822d-d74c9e525a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:45.565159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e8dee-8986-4798-822d-d74c9e525a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:45.565793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e8dee-8986-4798-822d-d74c9e525a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:45.567839 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e8dee-8986-4798-822d-d74c9e525a62 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:45.605538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1052/2093] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:41:45 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:41:45.607320 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd290c4-9221-407d-8683-b9709b17af00 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:45.626432 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd290c4-9221-407d-8683-b9709b17af00 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:45.684738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:45.690971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e8dee-8986-4798-822d-d74c9e525a62 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:45.692827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-885e8dee-8986-4798-822d-d74c9e525a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:45.697351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df199-d14e-49d3-8aef-a85d11cf78c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:45.698017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df199-d14e-49d3-8aef-a85d11cf78c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:45.698296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df199-d14e-49d3-8aef-a85d11cf78c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:45.698575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df199-d14e-49d3-8aef-a85d11cf78c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:45.699515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540df199-d14e-49d3-8aef-a85d11cf78c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:45.702310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540df199-d14e-49d3-8aef-a85d11cf78c5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:45.707666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e8dee-8986-4798-822d-d74c9e525a62 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:45.712558 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:45.713263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:45.713621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:45.713902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] PATH_INFO: `/v3/users/d743ca42c0ff416098c79749a0e3e3bf` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:45.715101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d743ca42c0ff416098c79749a0e3e3bf)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:45.717184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:45.727967 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1042/2094] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:41:45 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:41:45.732323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:45.732584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df199-d14e-49d3-8aef-a85d11cf78c5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:45.744691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df199-d14e-49d3-8aef-a85d11cf78c5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:45.750679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9731c6-0a18-415b-8e34-da514810cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:45.751335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9731c6-0a18-415b-8e34-da514810cd79 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:45.751719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9731c6-0a18-415b-8e34-da514810cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:45.751968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9731c6-0a18-415b-8e34-da514810cd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:45.752676 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9731c6-0a18-415b-8e34-da514810cd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:45.754293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9731c6-0a18-415b-8e34-da514810cd79 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:45.765017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1043/2095] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:41:45.768711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd743ca42c0ff416098c79749a0e3e3bf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:45.769071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9731c6-0a18-415b-8e34-da514810cd79 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:45.769396 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd743ca42c0ff416098c79749a0e3e3bf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:45.770750 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8d9731c6-0a18-415b-8e34-da514810cd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:45.776807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd743ca42c0ff416098c79749a0e3e3bf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:45.784404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9731c6-0a18-415b-8e34-da514810cd79 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:45.785847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd743ca42c0ff416098c79749a0e3e3bf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:45.786479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c8e418f9-933f-41b2-91ce-49acc86eb666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd743ca42c0ff416098c79749a0e3e3bf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:45.790080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2a0c8-2e27-4042-abae-a30bc8a28fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:45.790695 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2a0c8-2e27-4042-abae-a30bc8a28fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:45.791136 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2a0c8-2e27-4042-abae-a30bc8a28fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:45.791425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2a0c8-2e27-4042-abae-a30bc8a28fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:45.792395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2a0c8-2e27-4042-abae-a30bc8a28fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:45.794088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2a0c8-2e27-4042-abae-a30bc8a28fe0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:45.804050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1044/2096] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:41:45.805235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1053/2097] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:41:45 2022] DELETE /identity/v3/users/d743ca42c0ff416098c79749a0e3e3bf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:41:45.808525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2a0c8-2e27-4042-abae-a30bc8a28fe0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:45.819281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2a0c8-2e27-4042-abae-a30bc8a28fe0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:45.891931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85bdec-e02b-4d23-bf41-b6eb55fb8385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:45.892636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85bdec-e02b-4d23-bf41-b6eb55fb8385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:45.893056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85bdec-e02b-4d23-bf41-b6eb55fb8385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:45.893324 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85bdec-e02b-4d23-bf41-b6eb55fb8385 admin admin] PATH_INFO: `/v3/projects/de5dd6fbd1884e33844c0d54b4413033/users/25a18dcc9bec44639f40b36ce7e89e95/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:45.909314 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85bdec-e02b-4d23-bf41-b6eb55fb8385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5dd6fbd1884e33844c0d54b4413033, user_id=25a18dcc9bec44639f40b36ce7e89e95, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:45.911969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85bdec-e02b-4d23-bf41-b6eb55fb8385 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:45.930542 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1045/2098] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:41:45 2022] PUT /identity/v3/projects/de5dd6fbd1884e33844c0d54b4413033/users/25a18dcc9bec44639f40b36ce7e89e95/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:41:46.003330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec23e1-dce3-4f2a-9cd0-212a42eeae41 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:46.003626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec23e1-dce3-4f2a-9cd0-212a42eeae41 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:46.003900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec23e1-dce3-4f2a-9cd0-212a42eeae41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:46.008226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85bdec-e02b-4d23-bf41-b6eb55fb8385 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:46.010186 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-eb85bdec-e02b-4d23-bf41-b6eb55fb8385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:46.050067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c5ec23e1-dce3-4f2a-9cd0-212a42eeae41 None None] MFA Rules not processed for user `25a18dcc9bec44639f40b36ce7e89e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:46.051378 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c5ec23e1-dce3-4f2a-9cd0-212a42eeae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:46.086972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85bdec-e02b-4d23-bf41-b6eb55fb8385 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:46.091804 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:46.092436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:46.092747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:46.093015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] PATH_INFO: `/v3/projects/df51db5ecf9e4077a162f638d7f4511e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:46.094127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=df51db5ecf9e4077a162f638d7f4511e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:46.096055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:46.121035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1054/2099] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:46.134266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec23e1-dce3-4f2a-9cd0-212a42eeae41 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:46.135678 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c5ec23e1-dce3-4f2a-9cd0-212a42eeae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:46.142726 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:46.146739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df51db5ecf9e4077a162f638d7f4511e', 'request_id': 'req-1df1fbbe-b72f-421b-84c8-258274f9d55d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.154902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df51db5ecf9e4077a162f638d7f4511e', 'request_id': 'req-1df1fbbe-b72f-421b-84c8-258274f9d55d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.161339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df51db5ecf9e4077a162f638d7f4511e', 'request_id': 'req-1df1fbbe-b72f-421b-84c8-258274f9d55d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.173402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] The token cache is being invalidate because project df51db5ecf9e4077a162f638d7f4511e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:41:46.173710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.174362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.175937 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1046/2100] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:41:46 2022] DELETE /identity/v3/projects/df51db5ecf9e4077a162f638d7f4511e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:46.179862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:46.181175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:46.198987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec23e1-dce3-4f2a-9cd0-212a42eeae41 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:46.234635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:46.254163 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef726224-bd04-4b4e-b333-845afe709790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:46.254690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726224-bd04-4b4e-b333-845afe709790 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:46.254977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726224-bd04-4b4e-b333-845afe709790 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:46.255270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726224-bd04-4b4e-b333-845afe709790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:46.257022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef726224-bd04-4b4e-b333-845afe709790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:46.268092 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1fbbe-b72f-421b-84c8-258274f9d55d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:46.274194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:46.275335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:46.275553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:46.275828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] PATH_INFO: `/v3/users/15eb554599ab4833b4559e6e03107c32` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:46.277439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15eb554599ab4833b4559e6e03107c32)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:46.279679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:46.336038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef726224-bd04-4b4e-b333-845afe709790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:46.337475 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef726224-bd04-4b4e-b333-845afe709790 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:46.337857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15eb554599ab4833b4559e6e03107c32'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.338536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15eb554599ab4833b4559e6e03107c32'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.347253 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15eb554599ab4833b4559e6e03107c32'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.347946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15eb554599ab4833b4559e6e03107c32'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.351176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1055/2101] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:41:46.362268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-822dcab4-5020-4e7c-ad2c-69418b926208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15eb554599ab4833b4559e6e03107c32'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.375904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef726224-bd04-4b4e-b333-845afe709790 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:46.378139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef726224-bd04-4b4e-b333-845afe709790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:46.382477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1047/2102] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:41:46 2022] DELETE /identity/v3/users/15eb554599ab4833b4559e6e03107c32 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:41:46.424344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef726224-bd04-4b4e-b333-845afe709790 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:46.480305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:46.482167 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:46.482450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:46.482724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] PATH_INFO: `/v3/users/25a18dcc9bec44639f40b36ce7e89e95` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:46.483908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a18dcc9bec44639f40b36ce7e89e95)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:46.486122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:46.533013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a18dcc9bec44639f40b36ce7e89e95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.533691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a18dcc9bec44639f40b36ce7e89e95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.538075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:46.541911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a18dcc9bec44639f40b36ce7e89e95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.550309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a18dcc9bec44639f40b36ce7e89e95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.550994 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a18dcc9bec44639f40b36ce7e89e95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.568887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1056/2103] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:41:46 2022] DELETE /identity/v3/users/25a18dcc9bec44639f40b36ce7e89e95 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:41:46.573518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74206788-2c3a-47c3-8ac5-dd402342e3dc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:46.573953 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74206788-2c3a-47c3-8ac5-dd402342e3dc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:46.574049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74206788-2c3a-47c3-8ac5-dd402342e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:46.577880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:46.579273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:46.606949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-74206788-2c3a-47c3-8ac5-dd402342e3dc None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:46.608195 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-74206788-2c3a-47c3-8ac5-dd402342e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:46.629403 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:46.658196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fda4a2-0d50-4f2f-b24a-a738b001562d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:46.662966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:46.663731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:46.664130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:46.664416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] PATH_INFO: `/v3/projects/10001015666b479e933be8b35d3e85d5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:46.665603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10001015666b479e933be8b35d3e85d5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:46.667513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:46.676565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1048/2104] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:41:46.687127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74206788-2c3a-47c3-8ac5-dd402342e3dc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:46.688494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-74206788-2c3a-47c3-8ac5-dd402342e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:46.719020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10001015666b479e933be8b35d3e85d5', 'request_id': 'req-69789b0a-0a84-4b05-ab46-8d94bd268790'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.725408 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10001015666b479e933be8b35d3e85d5', 'request_id': 'req-69789b0a-0a84-4b05-ab46-8d94bd268790'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.732722 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10001015666b479e933be8b35d3e85d5', 'request_id': 'req-69789b0a-0a84-4b05-ab46-8d94bd268790'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.747231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] The token cache is being invalidate because project 10001015666b479e933be8b35d3e85d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:41:46.747524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.748347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:46.750754 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1057/2105] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:41:46 2022] DELETE /identity/v3/projects/10001015666b479e933be8b35d3e85d5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:46.781670 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74206788-2c3a-47c3-8ac5-dd402342e3dc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:46.839060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a563b-eb4f-4fcd-b1ef-adbeda1e57cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:46.839719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a563b-eb4f-4fcd-b1ef-adbeda1e57cb service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:46.840620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a563b-eb4f-4fcd-b1ef-adbeda1e57cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:46.841094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a563b-eb4f-4fcd-b1ef-adbeda1e57cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:46.843677 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b17a563b-eb4f-4fcd-b1ef-adbeda1e57cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:46.916694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a563b-eb4f-4fcd-b1ef-adbeda1e57cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:46.918360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a563b-eb4f-4fcd-b1ef-adbeda1e57cb service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:46.929484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1049/2106] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:41:47.224185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:47.225774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:47.239768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69789b0a-0a84-4b05-ab46-8d94bd268790 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:47.245967 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:47.245967 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.245967 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.245967 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] PATH_INFO: `/v3/projects/de5dd6fbd1884e33844c0d54b4413033` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.247845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5dd6fbd1884e33844c0d54b4413033)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:47.249783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:47.297263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5dd6fbd1884e33844c0d54b4413033', 'request_id': 'req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:47.300997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:47.303364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5dd6fbd1884e33844c0d54b4413033', 'request_id': 'req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:47.312236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5dd6fbd1884e33844c0d54b4413033', 'request_id': 'req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:47.325417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] The token cache is being invalidate because project de5dd6fbd1884e33844c0d54b4413033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:41:47.325710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:47.326357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b3a9a4f-50ae-4b39-878d-785dd2f0304e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:41:47.327837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1058/2107] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:41:47 2022] DELETE /identity/v3/projects/de5dd6fbd1884e33844c0d54b4413033 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:47.332903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d25af-c39a-4ab6-816f-b95e3172a786 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.333194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d25af-c39a-4ab6-816f-b95e3172a786 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.333473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d25af-c39a-4ab6-816f-b95e3172a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.353960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:47.382556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5b9d25af-c39a-4ab6-816f-b95e3172a786 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:47.383773 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5b9d25af-c39a-4ab6-816f-b95e3172a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:47.441633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1050/2108] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:47.449348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a28268-455a-41a9-88c2-85a436565a24 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.449657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a28268-455a-41a9-88c2-85a436565a24 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.449917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a28268-455a-41a9-88c2-85a436565a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.470788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-68a28268-455a-41a9-88c2-85a436565a24 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:47.472005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-68a28268-455a-41a9-88c2-85a436565a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:47.479957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1059/2109] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:47.484997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d25af-c39a-4ab6-816f-b95e3172a786 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:47.494396 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d25af-c39a-4ab6-816f-b95e3172a786 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:47.499122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb22ae1-1f5d-4a55-a4ec-17b84b47cc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:47.499718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb22ae1-1f5d-4a55-a4ec-17b84b47cc4a admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.500002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb22ae1-1f5d-4a55-a4ec-17b84b47cc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.500278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb22ae1-1f5d-4a55-a4ec-17b84b47cc4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.500968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb22ae1-1f5d-4a55-a4ec-17b84b47cc4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:41:47.501275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb22ae1-1f5d-4a55-a4ec-17b84b47cc4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:47.502877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb22ae1-1f5d-4a55-a4ec-17b84b47cc4a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:47.514858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1051/2110] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:41:47.519159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a28268-455a-41a9-88c2-85a436565a24 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:47.529067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a28268-455a-41a9-88c2-85a436565a24 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:47.533696 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48c682-3b03-4447-bae9-9b873bacbc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:47.534289 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48c682-3b03-4447-bae9-9b873bacbc1f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.534571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48c682-3b03-4447-bae9-9b873bacbc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.534844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48c682-3b03-4447-bae9-9b873bacbc1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.535482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48c682-3b03-4447-bae9-9b873bacbc1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:47.537389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48c682-3b03-4447-bae9-9b873bacbc1f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:47.564748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1060/2111] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:41:47 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:41:47.568907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb22ae1-1f5d-4a55-a4ec-17b84b47cc4a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:47.579502 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb22ae1-1f5d-4a55-a4ec-17b84b47cc4a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:47.634228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855239d-515f-43b7-af13-585eff50416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:47.635030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855239d-515f-43b7-af13-585eff50416f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.635310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855239d-515f-43b7-af13-585eff50416f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.635581 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855239d-515f-43b7-af13-585eff50416f admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.636209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855239d-515f-43b7-af13-585eff50416f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:47.638659 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855239d-515f-43b7-af13-585eff50416f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:47.659227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1052/2112] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:41:47 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:41:47.663287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48c682-3b03-4447-bae9-9b873bacbc1f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:47.673618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48c682-3b03-4447-bae9-9b873bacbc1f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:47.678248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c21b7-1faa-443c-b047-0a5e13908a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:47.678839 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c21b7-1faa-443c-b047-0a5e13908a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.679121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c21b7-1faa-443c-b047-0a5e13908a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.679395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c21b7-1faa-443c-b047-0a5e13908a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.680047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c21b7-1faa-443c-b047-0a5e13908a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:47.681656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c21b7-1faa-443c-b047-0a5e13908a50 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:47.692005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1061/2113] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:41:47.695851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855239d-515f-43b7-af13-585eff50416f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:47.706120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855239d-515f-43b7-af13-585eff50416f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:47.710686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42739ab-ce21-41d8-8ac0-efa3fb4bb651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:47.711275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42739ab-ce21-41d8-8ac0-efa3fb4bb651 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.711550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42739ab-ce21-41d8-8ac0-efa3fb4bb651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.711856 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42739ab-ce21-41d8-8ac0-efa3fb4bb651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.712507 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42739ab-ce21-41d8-8ac0-efa3fb4bb651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:47.714084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42739ab-ce21-41d8-8ac0-efa3fb4bb651 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:47.725204 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1053/2114] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:41:47.729229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c21b7-1faa-443c-b047-0a5e13908a50 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:47.740142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c21b7-1faa-443c-b047-0a5e13908a50 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:47.744741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735a0a5-5e66-4572-afad-51800abf4cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:47.745383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735a0a5-5e66-4572-afad-51800abf4cad admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.745662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735a0a5-5e66-4572-afad-51800abf4cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.745934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735a0a5-5e66-4572-afad-51800abf4cad admin admin] PATH_INFO: `/v3/projects/8b4d28975d27457799efd327c47bec5c/users/f6db44e3ed4e459c8298efc88c68d816/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.760925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735a0a5-5e66-4572-afad-51800abf4cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4d28975d27457799efd327c47bec5c, user_id=f6db44e3ed4e459c8298efc88c68d816, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:47.763777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735a0a5-5e66-4572-afad-51800abf4cad admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:47.776271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1062/2115] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:41:47 2022] PUT /identity/v3/projects/8b4d28975d27457799efd327c47bec5c/users/f6db44e3ed4e459c8298efc88c68d816/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:41:47.786158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a5c98-ff4c-4c58-9f74-7c0cfc6b23b6 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.786445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a5c98-ff4c-4c58-9f74-7c0cfc6b23b6 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.786719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a5c98-ff4c-4c58-9f74-7c0cfc6b23b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.814707 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-499a5c98-ff4c-4c58-9f74-7c0cfc6b23b6 None None] MFA Rules not processed for user `f6db44e3ed4e459c8298efc88c68d816`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:47.815974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-499a5c98-ff4c-4c58-9f74-7c0cfc6b23b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:47.860771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:41:47.881447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1054/2116] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:41:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:47.892901 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735a0a5-5e66-4572-afad-51800abf4cad admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:47.894566 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b735a0a5-5e66-4572-afad-51800abf4cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:47.950971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735a0a5-5e66-4572-afad-51800abf4cad admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:47.954631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b891-f84d-416f-a140-beb5e0b057f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:47.955231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b891-f84d-416f-a140-beb5e0b057f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:47.955513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b891-f84d-416f-a140-beb5e0b057f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:47.955786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b891-f84d-416f-a140-beb5e0b057f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:47.963917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2b891-f84d-416f-a140-beb5e0b057f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:47.965894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2b891-f84d-416f-a140-beb5e0b057f6 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:47.974432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1063/2117] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:41:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:41:57.358382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430604c-18fd-4772-b57e-5d59a24c1d74 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:57.358927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430604c-18fd-4772-b57e-5d59a24c1d74 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:57.358927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430604c-18fd-4772-b57e-5d59a24c1d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:57.389236 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2430604c-18fd-4772-b57e-5d59a24c1d74 None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:41:57.390450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2430604c-18fd-4772-b57e-5d59a24c1d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:57.451330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1055/2118] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:41:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:41:57.463395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b891-f84d-416f-a140-beb5e0b057f6 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:41:57.465043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eeb2b891-f84d-416f-a140-beb5e0b057f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:41:57.532700 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b891-f84d-416f-a140-beb5e0b057f6 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:41:57.537561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30876c24-8c3d-43ee-b7a4-0a3b3d6ee95f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:41:57.538159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30876c24-8c3d-43ee-b7a4-0a3b3d6ee95f service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:41:57.538436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30876c24-8c3d-43ee-b7a4-0a3b3d6ee95f service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:41:57.538707 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30876c24-8c3d-43ee-b7a4-0a3b3d6ee95f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:41:57.547310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30876c24-8c3d-43ee-b7a4-0a3b3d6ee95f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:41:57.548899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30876c24-8c3d-43ee-b7a4-0a3b3d6ee95f service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:41:57.556782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1064/2119] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:41:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:42:02.938834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430604c-18fd-4772-b57e-5d59a24c1d74 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:03.012743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430604c-18fd-4772-b57e-5d59a24c1d74 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:03.017513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:03.018161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:03.018529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:03.018834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] PATH_INFO: `/v3/users/f6db44e3ed4e459c8298efc88c68d816` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:03.020933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6db44e3ed4e459c8298efc88c68d816)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:03.022988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:03.081641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6db44e3ed4e459c8298efc88c68d816'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:03.082217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6db44e3ed4e459c8298efc88c68d816'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:03.090145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6db44e3ed4e459c8298efc88c68d816'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:03.090894 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6db44e3ed4e459c8298efc88c68d816'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:03.108061 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6db44e3ed4e459c8298efc88c68d816'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:03.112346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:03.126995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1056/2120] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:42:02 2022] DELETE /identity/v3/users/f6db44e3ed4e459c8298efc88c68d816 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:03.132557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d457f8-d4c1-41bc-b79e-ac445196ed9c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:03.133147 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d457f8-d4c1-41bc-b79e-ac445196ed9c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:03.133147 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d457f8-d4c1-41bc-b79e-ac445196ed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:03.155558 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-62d457f8-d4c1-41bc-b79e-ac445196ed9c None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:03.156872 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-62d457f8-d4c1-41bc-b79e-ac445196ed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:03.169451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:03.237990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1065/2121] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:03.249239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:03.250811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:03.350180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee892e3c-483b-4f21-8c6d-823c0ff752da admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:03.353668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcabdf3-0945-4eb0-9a0e-a4f7096cb20d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:03.354281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcabdf3-0945-4eb0-9a0e-a4f7096cb20d service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:03.354562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcabdf3-0945-4eb0-9a0e-a4f7096cb20d service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:03.355373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcabdf3-0945-4eb0-9a0e-a4f7096cb20d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:03.365143 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcabdf3-0945-4eb0-9a0e-a4f7096cb20d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:03.366745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcabdf3-0945-4eb0-9a0e-a4f7096cb20d service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:03.379965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1057/2122] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:03.694716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d457f8-d4c1-41bc-b79e-ac445196ed9c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:03.696335 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-62d457f8-d4c1-41bc-b79e-ac445196ed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:03.716817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d457f8-d4c1-41bc-b79e-ac445196ed9c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:03.722697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:03.723575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:03.735554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:03.736241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] PATH_INFO: `/v3/projects/8b4d28975d27457799efd327c47bec5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:03.737572 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4d28975d27457799efd327c47bec5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:03.740710 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:03.822495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4d28975d27457799efd327c47bec5c', 'request_id': 'req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:03.833310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4d28975d27457799efd327c47bec5c', 'request_id': 'req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:03.841490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4d28975d27457799efd327c47bec5c', 'request_id': 'req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:03.858314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] The token cache is being invalidate because project 8b4d28975d27457799efd327c47bec5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:42:03.858609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:03.859972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-41c367d9-35e6-4ebd-8604-8d8e733b6b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:03.864104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1066/2123] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:42:03 2022] DELETE /identity/v3/projects/8b4d28975d27457799efd327c47bec5c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:11.654472 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcabdf3-0945-4eb0-9a0e-a4f7096cb20d service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:11.655872 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-afcabdf3-0945-4eb0-9a0e-a4f7096cb20d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:11.747099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcabdf3-0945-4eb0-9a0e-a4f7096cb20d service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:11.813882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf20ff-d547-462e-8da6-2c3c81dd36d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:11.814488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf20ff-d547-462e-8da6-2c3c81dd36d8 service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:11.814763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf20ff-d547-462e-8da6-2c3c81dd36d8 service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:11.815034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf20ff-d547-462e-8da6-2c3c81dd36d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:11.816767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9caf20ff-d547-462e-8da6-2c3c81dd36d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:11.828038 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf20ff-d547-462e-8da6-2c3c81dd36d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:11.829856 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf20ff-d547-462e-8da6-2c3c81dd36d8 service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:11.841082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1058/2124] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:13.513535 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa5637-13d0-4bc4-882e-db5aa49a0f26 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:13.514093 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa5637-13d0-4bc4-882e-db5aa49a0f26 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:13.514191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa5637-13d0-4bc4-882e-db5aa49a0f26 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:13.515625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1067/2125] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:42:13.522650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d40d-94fa-406b-8a10-da134c4ef051 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:13.523111 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d40d-94fa-406b-8a10-da134c4ef051 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:13.523214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d40d-94fa-406b-8a10-da134c4ef051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:13.545692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:13.562420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6656d40d-94fa-406b-8a10-da134c4ef051 None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:13.563828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6656d40d-94fa-406b-8a10-da134c4ef051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:13.648389 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1059/2126] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:42:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:13.660648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa5637-13d0-4bc4-882e-db5aa49a0f26 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:13.663075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-12aa5637-13d0-4bc4-882e-db5aa49a0f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:13.723462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa5637-13d0-4bc4-882e-db5aa49a0f26 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:13.727031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e8a98-ab71-4898-b9a1-66d918f636fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b71b778b0b24cbb92446070934d68ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:13.727633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e8a98-ab71-4898-b9a1-66d918f636fd service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:13.727916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e8a98-ab71-4898-b9a1-66d918f636fd service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:13.728191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e8a98-ab71-4898-b9a1-66d918f636fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:13.738866 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e8a98-ab71-4898-b9a1-66d918f636fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:13.740291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e8a98-ab71-4898-b9a1-66d918f636fd service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:13.752333 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1068/2127] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:13.823388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f48b6f-f9bc-4834-b06c-457570bc1e54 None None] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:13.823641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f48b6f-f9bc-4834-b06c-457570bc1e54 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:13.823917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f48b6f-f9bc-4834-b06c-457570bc1e54 None None] PATH_INFO: `/` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:13.825289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1060/2128] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 03:42:13.830154 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4ec48-4474-4dc8-bc69-765d785cb6f1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:13.830451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4ec48-4474-4dc8-bc69-765d785cb6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:13.830737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4ec48-4474-4dc8-bc69-765d785cb6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:13.862966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-84a4ec48-4474-4dc8-bc69-765d785cb6f1 None None] MFA Rules not processed for user `aea5fababc0a497686549ed7b9b85c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:13.864489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-84a4ec48-4474-4dc8-bc69-765d785cb6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:13.886353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:13.930472 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1069/2129] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:42:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:13.942892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f48b6f-f9bc-4834-b06c-457570bc1e54 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:13.944665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a9f48b6f-f9bc-4834-b06c-457570bc1e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:13.958275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f48b6f-f9bc-4834-b06c-457570bc1e54 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:13.961811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5a9cf-d35a-4cff-8d73-f96340b3bde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:13.962436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a9cf-d35a-4cff-8d73-f96340b3bde3 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:13.962714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a9cf-d35a-4cff-8d73-f96340b3bde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:13.962990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5a9cf-d35a-4cff-8d73-f96340b3bde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:13.970414 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5a9cf-d35a-4cff-8d73-f96340b3bde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:13.971832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5a9cf-d35a-4cff-8d73-f96340b3bde3 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:13.980154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1061/2130] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:14.070398 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80cfb-6236-46e6-980b-944b179b4510 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:14.070683 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80cfb-6236-46e6-980b-944b179b4510 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:14.070982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80cfb-6236-46e6-980b-944b179b4510 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:14.072312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1070/2131] 10.222.0.20 () {54 vars in 921 bytes} [Wed Nov 2 03:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 03:42:14.077745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d726-162c-4a9d-b25c-3a5c1daaf5b5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:14.077976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d726-162c-4a9d-b25c-3a5c1daaf5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:14.078255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d726-162c-4a9d-b25c-3a5c1daaf5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:14.098388 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f349d726-162c-4a9d-b25c-3a5c1daaf5b5 None None] MFA Rules not processed for user `35afc6fb66a649e2a9d22ee01cccbc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:14.099598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f349d726-162c-4a9d-b25c-3a5c1daaf5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:14.110306 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1062/2132] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Nov 2 03:42:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:14.121625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80cfb-6236-46e6-980b-944b179b4510 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:14.132403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80cfb-6236-46e6-980b-944b179b4510 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:14.136420 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca83e-2143-49c4-a955-28ea669f0498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:14.137052 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca83e-2143-49c4-a955-28ea669f0498 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:14.137343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca83e-2143-49c4-a955-28ea669f0498 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:14.137621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca83e-2143-49c4-a955-28ea669f0498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:14.147787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfca83e-2143-49c4-a955-28ea669f0498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:14.149229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfca83e-2143-49c4-a955-28ea669f0498 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:14.160410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1071/2133] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:18.514775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5361ae0-9263-4112-a0aa-dcd0f0249d0d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:18.515391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5361ae0-9263-4112-a0aa-dcd0f0249d0d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:18.515391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5361ae0-9263-4112-a0aa-dcd0f0249d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:18.549873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d5361ae0-9263-4112-a0aa-dcd0f0249d0d None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:18.551532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d5361ae0-9263-4112-a0aa-dcd0f0249d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:18.623537 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1063/2134] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Nov 2 03:42:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:18.635237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca83e-2143-49c4-a955-28ea669f0498 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:18.637459 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dbfca83e-2143-49c4-a955-28ea669f0498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:18.713344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca83e-2143-49c4-a955-28ea669f0498 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:18.718976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357af7a6-79ad-40ba-8bdc-2e64ad7a5f3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:18.720289 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357af7a6-79ad-40ba-8bdc-2e64ad7a5f3c service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:18.720610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357af7a6-79ad-40ba-8bdc-2e64ad7a5f3c service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:18.721270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357af7a6-79ad-40ba-8bdc-2e64ad7a5f3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:18.731275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357af7a6-79ad-40ba-8bdc-2e64ad7a5f3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:18.732923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357af7a6-79ad-40ba-8bdc-2e64ad7a5f3c service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:18.741909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1072/2135] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:42:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:42:24.133059 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5361ae0-9263-4112-a0aa-dcd0f0249d0d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:24.145227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5361ae0-9263-4112-a0aa-dcd0f0249d0d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:24.149650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90055a3-dd62-4866-bcc5-331793fbf1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:24.150264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90055a3-dd62-4866-bcc5-331793fbf1df service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:24.150544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90055a3-dd62-4866-bcc5-331793fbf1df service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:24.150819 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90055a3-dd62-4866-bcc5-331793fbf1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:24.153141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f90055a3-dd62-4866-bcc5-331793fbf1df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:24.226617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90055a3-dd62-4866-bcc5-331793fbf1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:24.228106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90055a3-dd62-4866-bcc5-331793fbf1df service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:24.239897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1064/2136] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:28.223365 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357af7a6-79ad-40ba-8bdc-2e64ad7a5f3c service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:28.224856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-357af7a6-79ad-40ba-8bdc-2e64ad7a5f3c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:28.241184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357af7a6-79ad-40ba-8bdc-2e64ad7a5f3c service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:28.246748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:28.247392 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:28.247675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:28.247951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] PATH_INFO: `/v3/users/cbdfd88ab0f448e48e86379efa48a8dc` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:28.249650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbdfd88ab0f448e48e86379efa48a8dc)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:28.251561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:28.301927 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbdfd88ab0f448e48e86379efa48a8dc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:28.302780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbdfd88ab0f448e48e86379efa48a8dc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:28.312386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbdfd88ab0f448e48e86379efa48a8dc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:28.325401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbdfd88ab0f448e48e86379efa48a8dc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:28.326032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8d9a850a-5ee0-41b8-a9c6-81c957ed357c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbdfd88ab0f448e48e86379efa48a8dc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:28.345855 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1073/2137] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:42:28 2022] DELETE /identity/v3/users/cbdfd88ab0f448e48e86379efa48a8dc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:28.568180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90055a3-dd62-4866-bcc5-331793fbf1df service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:28.574674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:28.595549 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90055a3-dd62-4866-bcc5-331793fbf1df service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:28.653863 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:28.654500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:28.654782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:28.655054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] PATH_INFO: `/v3/projects/8e221044b7a44a849b1eaef9c18ae34d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:28.656176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e221044b7a44a849b1eaef9c18ae34d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:28.658150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:28.704049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e221044b7a44a849b1eaef9c18ae34d', 'request_id': 'req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:28.710903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e221044b7a44a849b1eaef9c18ae34d', 'request_id': 'req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:28.716447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e221044b7a44a849b1eaef9c18ae34d', 'request_id': 'req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:28.727278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] The token cache is being invalidate because project 8e221044b7a44a849b1eaef9c18ae34d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:42:28.727562 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:28.728190 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-8e4b91b7-528f-44bb-9779-4f2d3f7e4bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:28.730464 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1065/2138] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:42:28 2022] DELETE /identity/v3/projects/8e221044b7a44a849b1eaef9c18ae34d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:28.735670 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ddbc8-7d68-4192-ba90-e1fb2e855dd2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:28.735982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ddbc8-7d68-4192-ba90-e1fb2e855dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:28.736254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ddbc8-7d68-4192-ba90-e1fb2e855dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:28.756258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-796ddbc8-7d68-4192-ba90-e1fb2e855dd2 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:28.757503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-796ddbc8-7d68-4192-ba90-e1fb2e855dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:28.766733 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:28.818369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1074/2139] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:28.826114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6536a-a04f-4630-a700-7a9c08df9adb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:28.826401 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6536a-a04f-4630-a700-7a9c08df9adb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:28.826693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6536a-a04f-4630-a700-7a9c08df9adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:28.848560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5ca6536a-a04f-4630-a700-7a9c08df9adb None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:28.849769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5ca6536a-a04f-4630-a700-7a9c08df9adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:28.858199 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1066/2140] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:28.862611 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ddbc8-7d68-4192-ba90-e1fb2e855dd2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:28.872858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ddbc8-7d68-4192-ba90-e1fb2e855dd2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:28.877373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724dc7-38fa-4709-858b-b49fe0c94c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:28.878030 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724dc7-38fa-4709-858b-b49fe0c94c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:28.878315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724dc7-38fa-4709-858b-b49fe0c94c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:28.878584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724dc7-38fa-4709-858b-b49fe0c94c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:28.879226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d724dc7-38fa-4709-858b-b49fe0c94c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:42:28.879528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d724dc7-38fa-4709-858b-b49fe0c94c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:28.881133 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d724dc7-38fa-4709-858b-b49fe0c94c9f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:28.892642 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1075/2141] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:42:28.897041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6536a-a04f-4630-a700-7a9c08df9adb None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:28.907097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6536a-a04f-4630-a700-7a9c08df9adb None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:28.912412 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94c088-c455-45c1-b795-07c8771d2c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:28.913063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c088-c455-45c1-b795-07c8771d2c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:28.913467 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c088-c455-45c1-b795-07c8771d2c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:28.913599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c088-c455-45c1-b795-07c8771d2c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:28.914247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94c088-c455-45c1-b795-07c8771d2c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:28.916154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94c088-c455-45c1-b795-07c8771d2c56 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:28.944727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1067/2142] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:42:28 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:28.948818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724dc7-38fa-4709-858b-b49fe0c94c9f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:28.959095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724dc7-38fa-4709-858b-b49fe0c94c9f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:29.019891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4666d-1d24-4d65-9d6d-4fd8acb55534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:29.020526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4666d-1d24-4d65-9d6d-4fd8acb55534 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:29.020809 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4666d-1d24-4d65-9d6d-4fd8acb55534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:29.021107 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4666d-1d24-4d65-9d6d-4fd8acb55534 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:29.021756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4666d-1d24-4d65-9d6d-4fd8acb55534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:29.023650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4666d-1d24-4d65-9d6d-4fd8acb55534 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:29.045960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1076/2143] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:42:28 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:42:29.049829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94c088-c455-45c1-b795-07c8771d2c56 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:29.060847 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94c088-c455-45c1-b795-07c8771d2c56 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:29.065530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d3800-c4f9-4fa6-9643-8bb8df518851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:29.066131 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3800-c4f9-4fa6-9643-8bb8df518851 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:29.066408 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3800-c4f9-4fa6-9643-8bb8df518851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:29.066689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3800-c4f9-4fa6-9643-8bb8df518851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:29.067329 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d3800-c4f9-4fa6-9643-8bb8df518851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:29.068940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d3800-c4f9-4fa6-9643-8bb8df518851 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:29.080189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1068/2144] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:29.084348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4666d-1d24-4d65-9d6d-4fd8acb55534 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:29.094266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4666d-1d24-4d65-9d6d-4fd8acb55534 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:29.098790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1ee39-48a6-4196-a197-3748e2f53fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:29.099373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1ee39-48a6-4196-a197-3748e2f53fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:29.099651 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1ee39-48a6-4196-a197-3748e2f53fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:29.099950 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1ee39-48a6-4196-a197-3748e2f53fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:29.100694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1ee39-48a6-4196-a197-3748e2f53fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:29.102273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1ee39-48a6-4196-a197-3748e2f53fa2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:29.113674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1077/2145] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:42:29.117754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d3800-c4f9-4fa6-9643-8bb8df518851 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:29.128099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d3800-c4f9-4fa6-9643-8bb8df518851 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:29.132691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9c9a2-ce9a-4591-b9dc-585653416530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:29.133328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9c9a2-ce9a-4591-b9dc-585653416530 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:29.133605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9c9a2-ce9a-4591-b9dc-585653416530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:29.133877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9c9a2-ce9a-4591-b9dc-585653416530 admin admin] PATH_INFO: `/v3/projects/274a457a30324a188ceb45d74069b1f4/users/dd90b3b3bf2145998a1f2f9ae3b706ae/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:29.148057 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9c9a2-ce9a-4591-b9dc-585653416530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274a457a30324a188ceb45d74069b1f4, user_id=dd90b3b3bf2145998a1f2f9ae3b706ae, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:29.150717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9c9a2-ce9a-4591-b9dc-585653416530 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:29.164010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1069/2146] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:29 2022] PUT /identity/v3/projects/274a457a30324a188ceb45d74069b1f4/users/dd90b3b3bf2145998a1f2f9ae3b706ae/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:29.175556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61660851-4235-40bd-8352-5115c57ffda2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:29.175841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61660851-4235-40bd-8352-5115c57ffda2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:29.176113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61660851-4235-40bd-8352-5115c57ffda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:29.203099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-61660851-4235-40bd-8352-5115c57ffda2 None None] MFA Rules not processed for user `dd90b3b3bf2145998a1f2f9ae3b706ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:29.204303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-61660851-4235-40bd-8352-5115c57ffda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:29.268152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1078/2147] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:29.280564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9c9a2-ce9a-4591-b9dc-585653416530 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:29.282644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-35a9c9a2-ce9a-4591-b9dc-585653416530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:29.314765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:29.358692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9c9a2-ce9a-4591-b9dc-585653416530 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:29.364759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c23d93-7c5f-414b-aabe-faf5c7499682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:29.365424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c23d93-7c5f-414b-aabe-faf5c7499682 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:29.365702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c23d93-7c5f-414b-aabe-faf5c7499682 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:29.365973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c23d93-7c5f-414b-aabe-faf5c7499682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:29.374345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c23d93-7c5f-414b-aabe-faf5c7499682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:29.376038 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c23d93-7c5f-414b-aabe-faf5c7499682 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:29.384740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1070/2148] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:42:32.067008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61660851-4235-40bd-8352-5115c57ffda2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:32.076929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:32.127240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61660851-4235-40bd-8352-5115c57ffda2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:32.131640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:32.132255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:32.132564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:32.132840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] PATH_INFO: `/v3/users/dd90b3b3bf2145998a1f2f9ae3b706ae` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:32.133938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd90b3b3bf2145998a1f2f9ae3b706ae)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:32.135858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:32.305163 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd90b3b3bf2145998a1f2f9ae3b706ae'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:32.305822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd90b3b3bf2145998a1f2f9ae3b706ae'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:32.313867 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd90b3b3bf2145998a1f2f9ae3b706ae'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:32.321223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd90b3b3bf2145998a1f2f9ae3b706ae'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:32.321907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd90b3b3bf2145998a1f2f9ae3b706ae'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:32.339697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1079/2149] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:42:32 2022] DELETE /identity/v3/users/dd90b3b3bf2145998a1f2f9ae3b706ae => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:32.344273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f016e-2fa1-48a9-a7e4-aec5f40d0bfb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:32.344776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f016e-2fa1-48a9-a7e4-aec5f40d0bfb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:32.344905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f016e-2fa1-48a9-a7e4-aec5f40d0bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:32.367285 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-494f016e-2fa1-48a9-a7e4-aec5f40d0bfb None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:32.368733 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-494f016e-2fa1-48a9-a7e4-aec5f40d0bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:32.427528 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1071/2150] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:32.437479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:32.438903 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:32.526012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed284742-777c-410d-8bfa-1aaa6e7a8219 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:32.531443 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7354f-a75a-42a4-856b-853e373fb978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:32.532063 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7354f-a75a-42a4-856b-853e373fb978 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:32.532359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7354f-a75a-42a4-856b-853e373fb978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:32.532655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7354f-a75a-42a4-856b-853e373fb978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:32.543700 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7354f-a75a-42a4-856b-853e373fb978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:32.545187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7354f-a75a-42a4-856b-853e373fb978 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:32.557020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1080/2151] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:42:32.883131 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f016e-2fa1-48a9-a7e4-aec5f40d0bfb None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:32.884615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-494f016e-2fa1-48a9-a7e4-aec5f40d0bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:32.898890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f016e-2fa1-48a9-a7e4-aec5f40d0bfb None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:32.904128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:32.904886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:32.905224 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:32.905593 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] PATH_INFO: `/v3/projects/274a457a30324a188ceb45d74069b1f4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:32.906886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=274a457a30324a188ceb45d74069b1f4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:32.909219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:32.965028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274a457a30324a188ceb45d74069b1f4', 'request_id': 'req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:32.972390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274a457a30324a188ceb45d74069b1f4', 'request_id': 'req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:32.978293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274a457a30324a188ceb45d74069b1f4', 'request_id': 'req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:32.989973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] The token cache is being invalidate because project 274a457a30324a188ceb45d74069b1f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:42:32.990260 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:32.990886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c545d5d9-e00a-444a-9abd-bb67db9e3fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:32.992336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1072/2152] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:42:32 2022] DELETE /identity/v3/projects/274a457a30324a188ceb45d74069b1f4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:32.997995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a2a8-d12c-4cae-9a27-3335c58b24a5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:32.998284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a2a8-d12c-4cae-9a27-3335c58b24a5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:32.998567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a2a8-d12c-4cae-9a27-3335c58b24a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.018737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a909a2a8-d12c-4cae-9a27-3335c58b24a5 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:33.019885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a909a2a8-d12c-4cae-9a27-3335c58b24a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:33.048631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:33.081567 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1081/2153] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:33.089667 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3262ec-1704-43f4-940a-d9c361dcd649 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.089871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3262ec-1704-43f4-940a-d9c361dcd649 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.090145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3262ec-1704-43f4-940a-d9c361dcd649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.109598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1a3262ec-1704-43f4-940a-d9c361dcd649 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:33.110789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1a3262ec-1704-43f4-940a-d9c361dcd649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:33.118474 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1073/2154] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:33.123128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a2a8-d12c-4cae-9a27-3335c58b24a5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.132798 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a2a8-d12c-4cae-9a27-3335c58b24a5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:33.138249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3512de7-6d86-4624-958a-33f0b069108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:33.138847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512de7-6d86-4624-958a-33f0b069108e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.139130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512de7-6d86-4624-958a-33f0b069108e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.139402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512de7-6d86-4624-958a-33f0b069108e admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.140049 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3512de7-6d86-4624-958a-33f0b069108e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:42:33.140362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3512de7-6d86-4624-958a-33f0b069108e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:33.141990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3512de7-6d86-4624-958a-33f0b069108e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:33.153791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1082/2155] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:42:33.157921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3262ec-1704-43f4-940a-d9c361dcd649 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.168112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3262ec-1704-43f4-940a-d9c361dcd649 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:33.173269 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febc198-e6dd-4147-8335-f06f6c9e167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:33.173871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febc198-e6dd-4147-8335-f06f6c9e167e admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.174167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febc198-e6dd-4147-8335-f06f6c9e167e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.174431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febc198-e6dd-4147-8335-f06f6c9e167e admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.175062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febc198-e6dd-4147-8335-f06f6c9e167e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:33.176995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febc198-e6dd-4147-8335-f06f6c9e167e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:33.205006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1074/2156] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:42:33 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:33.209183 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3512de7-6d86-4624-958a-33f0b069108e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.219407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3512de7-6d86-4624-958a-33f0b069108e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:33.278592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcdb63-5b91-4135-8411-d9e0a828c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:33.279240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcdb63-5b91-4135-8411-d9e0a828c03a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.279604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcdb63-5b91-4135-8411-d9e0a828c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.280391 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcdb63-5b91-4135-8411-d9e0a828c03a admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.281304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcdb63-5b91-4135-8411-d9e0a828c03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:33.284033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcdb63-5b91-4135-8411-d9e0a828c03a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:33.306998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1083/2157] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:42:33 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:33.311894 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febc198-e6dd-4147-8335-f06f6c9e167e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.322211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febc198-e6dd-4147-8335-f06f6c9e167e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:33.326874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9313e36-0e11-48ee-a761-d3229802e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:33.327474 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9313e36-0e11-48ee-a761-d3229802e9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.327756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9313e36-0e11-48ee-a761-d3229802e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.328031 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9313e36-0e11-48ee-a761-d3229802e9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.328778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9313e36-0e11-48ee-a761-d3229802e9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:33.330372 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9313e36-0e11-48ee-a761-d3229802e9e9 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:33.332530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:33.341835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1075/2158] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:33.345447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcdb63-5b91-4135-8411-d9e0a828c03a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.355904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcdb63-5b91-4135-8411-d9e0a828c03a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:33.360836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430e0da-1c42-48c1-84c6-994a8818eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:33.361448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e0da-1c42-48c1-84c6-994a8818eaaa admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.361728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e0da-1c42-48c1-84c6-994a8818eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.361998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e0da-1c42-48c1-84c6-994a8818eaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.362634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430e0da-1c42-48c1-84c6-994a8818eaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:33.364194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430e0da-1c42-48c1-84c6-994a8818eaaa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:33.376796 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1084/2159] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:33.381471 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9313e36-0e11-48ee-a761-d3229802e9e9 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.391869 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9313e36-0e11-48ee-a761-d3229802e9e9 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:33.396743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4d29-347c-4181-87dd-77c4e5e09d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:33.397414 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4d29-347c-4181-87dd-77c4e5e09d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.397690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4d29-347c-4181-87dd-77c4e5e09d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.397964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4d29-347c-4181-87dd-77c4e5e09d7e admin admin] PATH_INFO: `/v3/projects/618a76ce167640c48f6272f01c6207d7/users/07e60203f2564180bb14af52556bafea/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.414526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4d29-347c-4181-87dd-77c4e5e09d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=618a76ce167640c48f6272f01c6207d7, user_id=07e60203f2564180bb14af52556bafea, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:33.417985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4d29-347c-4181-87dd-77c4e5e09d7e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:33.432831 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1076/2160] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:33 2022] PUT /identity/v3/projects/618a76ce167640c48f6272f01c6207d7/users/07e60203f2564180bb14af52556bafea/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:33.448336 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eee52-8aad-4645-a3c1-7c0fe08f2dbd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.448776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eee52-8aad-4645-a3c1-7c0fe08f2dbd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.448989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eee52-8aad-4645-a3c1-7c0fe08f2dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.480830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0f6eee52-8aad-4645-a3c1-7c0fe08f2dbd None None] MFA Rules not processed for user `07e60203f2564180bb14af52556bafea`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:33.482633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0f6eee52-8aad-4645-a3c1-7c0fe08f2dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:33.554715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1085/2161] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:33.560582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4d29-347c-4181-87dd-77c4e5e09d7e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.632606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4d29-347c-4181-87dd-77c4e5e09d7e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:33.637954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ac759-8695-49a9-875b-4dff9e0abe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:33.638570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ac759-8695-49a9-875b-4dff9e0abe32 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.638855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ac759-8695-49a9-875b-4dff9e0abe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.639131 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ac759-8695-49a9-875b-4dff9e0abe32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.639763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ac759-8695-49a9-875b-4dff9e0abe32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:33.641773 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ac759-8695-49a9-875b-4dff9e0abe32 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:33.677521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1077/2162] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:42:33 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:33.682629 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6eee52-8aad-4645-a3c1-7c0fe08f2dbd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.697106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6eee52-8aad-4645-a3c1-7c0fe08f2dbd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:33.735904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:33.775302 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8aa33-d094-4148-89ac-bf4a340b17b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:33.776011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8aa33-d094-4148-89ac-bf4a340b17b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.776230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8aa33-d094-4148-89ac-bf4a340b17b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.777099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8aa33-d094-4148-89ac-bf4a340b17b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.777853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8aa33-d094-4148-89ac-bf4a340b17b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:33.781852 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8aa33-d094-4148-89ac-bf4a340b17b8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:33.811941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1086/2163] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:42:33 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:33.816490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ac759-8695-49a9-875b-4dff9e0abe32 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.834142 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ac759-8695-49a9-875b-4dff9e0abe32 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:33.841869 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f203df-d147-486f-9364-56f54f233bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:33.842730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f203df-d147-486f-9364-56f54f233bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.843050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f203df-d147-486f-9364-56f54f233bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.843323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f203df-d147-486f-9364-56f54f233bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.844125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f203df-d147-486f-9364-56f54f233bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:33.845803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f203df-d147-486f-9364-56f54f233bfb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:33.860054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1078/2164] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:33.866703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8aa33-d094-4148-89ac-bf4a340b17b8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.892425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8aa33-d094-4148-89ac-bf4a340b17b8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:33.898214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1665e-072e-4b96-8c1d-6074d180825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:33.898920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1665e-072e-4b96-8c1d-6074d180825a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:33.899548 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1665e-072e-4b96-8c1d-6074d180825a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:33.900213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1665e-072e-4b96-8c1d-6074d180825a admin admin] PATH_INFO: `/v3/projects/f78d4fbbbefc40c2adaec59fcf6fc4c3/users/491b68c51f3e44e69f1b0673bbf8915f/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:33.920352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1665e-072e-4b96-8c1d-6074d180825a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78d4fbbbefc40c2adaec59fcf6fc4c3, user_id=491b68c51f3e44e69f1b0673bbf8915f, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:33.923790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1665e-072e-4b96-8c1d-6074d180825a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:33.938635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1087/2165] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:33 2022] PUT /identity/v3/projects/f78d4fbbbefc40c2adaec59fcf6fc4c3/users/491b68c51f3e44e69f1b0673bbf8915f/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:33.942835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f203df-d147-486f-9364-56f54f233bfb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:33.953264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f203df-d147-486f-9364-56f54f233bfb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:34.023398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8b826-5e2a-420f-8a6b-66a87ea3896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:34.024022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b826-5e2a-420f-8a6b-66a87ea3896c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:34.024301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b826-5e2a-420f-8a6b-66a87ea3896c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:34.024621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b826-5e2a-420f-8a6b-66a87ea3896c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:34.025256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8b826-5e2a-420f-8a6b-66a87ea3896c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:34.027546 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8b826-5e2a-420f-8a6b-66a87ea3896c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:34.037865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1079/2166] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:34.043094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1665e-072e-4b96-8c1d-6074d180825a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:34.056808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1665e-072e-4b96-8c1d-6074d180825a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:34.062071 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04434-f273-4782-a6d3-fb2fa658a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:34.062831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04434-f273-4782-a6d3-fb2fa658a69f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:34.063250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04434-f273-4782-a6d3-fb2fa658a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:34.063536 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04434-f273-4782-a6d3-fb2fa658a69f admin admin] PATH_INFO: `/v3/projects/f78d4fbbbefc40c2adaec59fcf6fc4c3/users/491b68c51f3e44e69f1b0673bbf8915f/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:34.065647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04434-f273-4782-a6d3-fb2fa658a69f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78d4fbbbefc40c2adaec59fcf6fc4c3, user_id=491b68c51f3e44e69f1b0673bbf8915f, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:34.068280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04434-f273-4782-a6d3-fb2fa658a69f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:34.080945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1088/2167] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:34 2022] PUT /identity/v3/projects/f78d4fbbbefc40c2adaec59fcf6fc4c3/users/491b68c51f3e44e69f1b0673bbf8915f/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:34.091958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9409-80eb-4863-9a7c-0cbed5624ffb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:34.092243 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9409-80eb-4863-9a7c-0cbed5624ffb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:34.092541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9409-80eb-4863-9a7c-0cbed5624ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:34.126095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-a54d9409-80eb-4863-9a7c-0cbed5624ffb None None] MFA Rules not processed for user `491b68c51f3e44e69f1b0673bbf8915f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:34.127308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a54d9409-80eb-4863-9a7c-0cbed5624ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:34.165003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:34.205102 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1080/2168] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:34.217779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04434-f273-4782-a6d3-fb2fa658a69f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:34.219502 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-53b04434-f273-4782-a6d3-fb2fa658a69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:34.300483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04434-f273-4782-a6d3-fb2fa658a69f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:34.304267 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee25c-40bb-4d03-bf67-2906ca3177e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:34.304905 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee25c-40bb-4d03-bf67-2906ca3177e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:34.305184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee25c-40bb-4d03-bf67-2906ca3177e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:34.305452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee25c-40bb-4d03-bf67-2906ca3177e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:34.314331 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ee25c-40bb-4d03-bf67-2906ca3177e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:34.315734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ee25c-40bb-4d03-bf67-2906ca3177e8 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:34.325379 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1089/2169] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:34.400414 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d9409-80eb-4863-9a7c-0cbed5624ffb None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:34.410601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d9409-80eb-4863-9a7c-0cbed5624ffb None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:34.414356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72b3cb-9ff1-4c1f-a559-b4433d0dfd5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:34.414959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b3cb-9ff1-4c1f-a559-b4433d0dfd5f service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:34.415292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b3cb-9ff1-4c1f-a559-b4433d0dfd5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:34.415517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72b3cb-9ff1-4c1f-a559-b4433d0dfd5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:34.471741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72b3cb-9ff1-4c1f-a559-b4433d0dfd5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:34.473244 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72b3cb-9ff1-4c1f-a559-b4433d0dfd5f service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:34.483124 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1081/2170] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:40.075623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f779ac-ed1f-4954-8377-db70a534a23d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:40.076118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f779ac-ed1f-4954-8377-db70a534a23d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:40.076282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f779ac-ed1f-4954-8377-db70a534a23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:40.128909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-77f779ac-ed1f-4954-8377-db70a534a23d None None] MFA Rules not processed for user `8937e32b919e4f5882ec84250147cbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:40.137186 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-77f779ac-ed1f-4954-8377-db70a534a23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:40.214387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1090/2171] 10.222.0.20 () {58 vars in 967 bytes} [Wed Nov 2 03:42:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:40.248148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72b3cb-9ff1-4c1f-a559-b4433d0dfd5f service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:40.249634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ef72b3cb-9ff1-4c1f-a559-b4433d0dfd5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:40.408074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72b3cb-9ff1-4c1f-a559-b4433d0dfd5f service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:40.416454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aec5e-b130-414e-a4d9-5e4ab89e83e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89782ff12f5c49da80c7568ccab38c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:40.417696 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aec5e-b130-414e-a4d9-5e4ab89e83e0 service swift] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:40.417980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aec5e-b130-414e-a4d9-5e4ab89e83e0 service swift] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:40.418259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aec5e-b130-414e-a4d9-5e4ab89e83e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:40.433313 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aec5e-b130-414e-a4d9-5e4ab89e83e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:40.434945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aec5e-b130-414e-a4d9-5e4ab89e83e0 service swift] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:40.444245 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1082/2172] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Nov 2 03:42:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 03:42:45.540129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f779ac-ed1f-4954-8377-db70a534a23d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:45.542785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-77f779ac-ed1f-4954-8377-db70a534a23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:45.553074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:45.602248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f779ac-ed1f-4954-8377-db70a534a23d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:45.608022 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60032928-e284-4c68-9008-683ffa910ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:45.608931 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60032928-e284-4c68-9008-683ffa910ccc service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:45.609258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60032928-e284-4c68-9008-683ffa910ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:45.609501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60032928-e284-4c68-9008-683ffa910ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:45.611656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-60032928-e284-4c68-9008-683ffa910ccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:45.674675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60032928-e284-4c68-9008-683ffa910ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:45.676108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60032928-e284-4c68-9008-683ffa910ccc service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:45.686290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1091/2173] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:48.971114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aec5e-b130-414e-a4d9-5e4ab89e83e0 service swift] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:48.972753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e06aec5e-b130-414e-a4d9-5e4ab89e83e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:48.990242 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aec5e-b130-414e-a4d9-5e4ab89e83e0 service swift] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:48.995385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:48.996021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:48.996438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:48.996742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] PATH_INFO: `/v3/users/e0281fe66a8047f7ae0d8d7d48dc8470` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:48.997910 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0281fe66a8047f7ae0d8d7d48dc8470)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:48.999896 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:49.055229 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0281fe66a8047f7ae0d8d7d48dc8470'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:49.056003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0281fe66a8047f7ae0d8d7d48dc8470'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:49.061754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:49.065328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0281fe66a8047f7ae0d8d7d48dc8470'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:49.066152 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0281fe66a8047f7ae0d8d7d48dc8470'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:49.079123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c5d55140-8b6d-487b-9360-1d9b7cd3ac9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0281fe66a8047f7ae0d8d7d48dc8470'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:49.091527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1083/2174] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:42:48 2022] DELETE /identity/v3/users/e0281fe66a8047f7ae0d8d7d48dc8470 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:49.268519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60032928-e284-4c68-9008-683ffa910ccc service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:49.283702 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60032928-e284-4c68-9008-683ffa910ccc service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:49.343191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:49.343821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:49.344104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:49.344398 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] PATH_INFO: `/v3/projects/2647ae424107471bb395d52ad56bd894` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:49.345526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2647ae424107471bb395d52ad56bd894)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:49.347406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:49.396082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2647ae424107471bb395d52ad56bd894', 'request_id': 'req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:49.402248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2647ae424107471bb395d52ad56bd894', 'request_id': 'req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:49.404120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:49.410299 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2647ae424107471bb395d52ad56bd894', 'request_id': 'req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:49.423606 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] The token cache is being invalidate because project 2647ae424107471bb395d52ad56bd894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:42:49.423896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:49.424551 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c3ca8801-a5ca-4f8a-a1aa-6c7344ceb384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:49.426032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1092/2175] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:42:49 2022] DELETE /identity/v3/projects/2647ae424107471bb395d52ad56bd894 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:49.431036 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68005034-ea25-4544-b8e0-3cde857e02cc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:49.431328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68005034-ea25-4544-b8e0-3cde857e02cc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:49.431634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68005034-ea25-4544-b8e0-3cde857e02cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:49.451448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-68005034-ea25-4544-b8e0-3cde857e02cc None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:49.452678 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-68005034-ea25-4544-b8e0-3cde857e02cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:49.510662 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1084/2176] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:49.518807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0ec5-306e-4048-8006-0e58f6bac470 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:49.519200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0ec5-306e-4048-8006-0e58f6bac470 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:49.519479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0ec5-306e-4048-8006-0e58f6bac470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:49.538773 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-854e0ec5-306e-4048-8006-0e58f6bac470 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:49.539995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-854e0ec5-306e-4048-8006-0e58f6bac470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:49.548391 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1093/2177] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:49.552765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68005034-ea25-4544-b8e0-3cde857e02cc None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:49.563139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68005034-ea25-4544-b8e0-3cde857e02cc None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:49.567701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe91b3-ff57-4f51-a23a-fd235e9d4852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:49.568280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe91b3-ff57-4f51-a23a-fd235e9d4852 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:49.568590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe91b3-ff57-4f51-a23a-fd235e9d4852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:49.568865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe91b3-ff57-4f51-a23a-fd235e9d4852 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:49.569512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe91b3-ff57-4f51-a23a-fd235e9d4852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:42:49.569815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe91b3-ff57-4f51-a23a-fd235e9d4852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:49.571461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe91b3-ff57-4f51-a23a-fd235e9d4852 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:49.582922 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1085/2178] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:42:49.587221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e0ec5-306e-4048-8006-0e58f6bac470 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:49.596291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e0ec5-306e-4048-8006-0e58f6bac470 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:49.601076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d0028-c0fe-4556-b6b2-3fd9ded86771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:49.601667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0028-c0fe-4556-b6b2-3fd9ded86771 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:49.602329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0028-c0fe-4556-b6b2-3fd9ded86771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:49.602329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0028-c0fe-4556-b6b2-3fd9ded86771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:49.602811 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d0028-c0fe-4556-b6b2-3fd9ded86771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:49.605209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d0028-c0fe-4556-b6b2-3fd9ded86771 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:49.633411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1094/2179] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:42:49 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:49.637572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe91b3-ff57-4f51-a23a-fd235e9d4852 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:49.647785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe91b3-ff57-4f51-a23a-fd235e9d4852 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:49.706108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828e466-8478-4bca-b37c-c0a082452083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:49.706734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828e466-8478-4bca-b37c-c0a082452083 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:49.707014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828e466-8478-4bca-b37c-c0a082452083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:49.707287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828e466-8478-4bca-b37c-c0a082452083 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:49.707956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828e466-8478-4bca-b37c-c0a082452083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:49.709929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828e466-8478-4bca-b37c-c0a082452083 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:49.733285 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1086/2180] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:42:49 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:49.738743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d0028-c0fe-4556-b6b2-3fd9ded86771 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:49.751036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d0028-c0fe-4556-b6b2-3fd9ded86771 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:49.755668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9248a-5332-461d-a63b-b68bced93dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:49.756263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9248a-5332-461d-a63b-b68bced93dea admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:49.756575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9248a-5332-461d-a63b-b68bced93dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:49.756850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9248a-5332-461d-a63b-b68bced93dea admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:49.757488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9248a-5332-461d-a63b-b68bced93dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:49.759073 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9248a-5332-461d-a63b-b68bced93dea admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:49.768901 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1095/2181] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:49.772920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828e466-8478-4bca-b37c-c0a082452083 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:49.783889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828e466-8478-4bca-b37c-c0a082452083 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:49.788571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86f52b-c5a0-4742-aff7-515279fb22d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:49.789174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86f52b-c5a0-4742-aff7-515279fb22d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:49.789458 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86f52b-c5a0-4742-aff7-515279fb22d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:49.789738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86f52b-c5a0-4742-aff7-515279fb22d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:49.790384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86f52b-c5a0-4742-aff7-515279fb22d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:49.793235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86f52b-c5a0-4742-aff7-515279fb22d6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:49.804693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1087/2182] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:49.809400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9248a-5332-461d-a63b-b68bced93dea admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:49.819376 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9248a-5332-461d-a63b-b68bced93dea admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:49.824042 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70048d-31b2-43bd-9551-78a78e48759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:49.824718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70048d-31b2-43bd-9551-78a78e48759c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:49.825002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70048d-31b2-43bd-9551-78a78e48759c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:49.825278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70048d-31b2-43bd-9551-78a78e48759c admin admin] PATH_INFO: `/v3/projects/e8fb01a3799d4da79face1e77b5a99b9/users/5c1ee1b08a784ffe902540dd49eed138/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:49.840957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70048d-31b2-43bd-9551-78a78e48759c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fb01a3799d4da79face1e77b5a99b9, user_id=5c1ee1b08a784ffe902540dd49eed138, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:49.843619 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70048d-31b2-43bd-9551-78a78e48759c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:49.857249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1096/2183] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:49 2022] PUT /identity/v3/projects/e8fb01a3799d4da79face1e77b5a99b9/users/5c1ee1b08a784ffe902540dd49eed138/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:42:49.868718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1e79-6941-4cbb-8d20-554d653ef4e5 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:49.869006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1e79-6941-4cbb-8d20-554d653ef4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:49.869303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1e79-6941-4cbb-8d20-554d653ef4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:49.896348 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-707b1e79-6941-4cbb-8d20-554d653ef4e5 None None] MFA Rules not processed for user `5c1ee1b08a784ffe902540dd49eed138`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:49.897587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-707b1e79-6941-4cbb-8d20-554d653ef4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:49.922889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:49.964210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1088/2184] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:49.968724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70048d-31b2-43bd-9551-78a78e48759c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:50.029439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70048d-31b2-43bd-9551-78a78e48759c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:50.034078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223e2e-4992-43f6-92f3-c7791ff8c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:50.034676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223e2e-4992-43f6-92f3-c7791ff8c568 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:50.034960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223e2e-4992-43f6-92f3-c7791ff8c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:50.035230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223e2e-4992-43f6-92f3-c7791ff8c568 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:50.035864 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223e2e-4992-43f6-92f3-c7791ff8c568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:50.037772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223e2e-4992-43f6-92f3-c7791ff8c568 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:50.065460 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1097/2185] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:42:49 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:50.069561 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1e79-6941-4cbb-8d20-554d653ef4e5 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:50.080504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1e79-6941-4cbb-8d20-554d653ef4e5 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:50.138436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540b30b-815d-4f17-9f72-6b33a898d6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:50.139038 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540b30b-815d-4f17-9f72-6b33a898d6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:50.139314 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540b30b-815d-4f17-9f72-6b33a898d6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:50.139581 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540b30b-815d-4f17-9f72-6b33a898d6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:50.140249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540b30b-815d-4f17-9f72-6b33a898d6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:50.142191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540b30b-815d-4f17-9f72-6b33a898d6e3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:50.162686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1089/2186] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:42:50 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:42:50.166787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223e2e-4992-43f6-92f3-c7791ff8c568 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:50.177084 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223e2e-4992-43f6-92f3-c7791ff8c568 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:50.181657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb3e85-2c85-4ce0-ae2d-a06f7949b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:50.182453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb3e85-2c85-4ce0-ae2d-a06f7949b31e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:50.182736 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb3e85-2c85-4ce0-ae2d-a06f7949b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:50.183010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb3e85-2c85-4ce0-ae2d-a06f7949b31e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:50.183646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb3e85-2c85-4ce0-ae2d-a06f7949b31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:50.185276 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb3e85-2c85-4ce0-ae2d-a06f7949b31e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:50.195833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1098/2187] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:50.200447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540b30b-815d-4f17-9f72-6b33a898d6e3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:50.210286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540b30b-815d-4f17-9f72-6b33a898d6e3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:50.214955 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7ab34-8aff-44ce-bc29-c1113357775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:50.215593 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7ab34-8aff-44ce-bc29-c1113357775a admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:50.215871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7ab34-8aff-44ce-bc29-c1113357775a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:50.216140 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7ab34-8aff-44ce-bc29-c1113357775a admin admin] PATH_INFO: `/v3/projects/26c4d68ae3a048389cfdfc1c86d37a09/users/e547ccdff7914bb6b9bbebefbc0f3f7c/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:50.231113 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7ab34-8aff-44ce-bc29-c1113357775a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c4d68ae3a048389cfdfc1c86d37a09, user_id=e547ccdff7914bb6b9bbebefbc0f3f7c, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:50.234032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7ab34-8aff-44ce-bc29-c1113357775a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:50.246902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1090/2188] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:50 2022] PUT /identity/v3/projects/26c4d68ae3a048389cfdfc1c86d37a09/users/e547ccdff7914bb6b9bbebefbc0f3f7c/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:50.250818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb3e85-2c85-4ce0-ae2d-a06f7949b31e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:50.261207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb3e85-2c85-4ce0-ae2d-a06f7949b31e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:50.316850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7947a-4400-47ea-8899-4680aa7d65ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:50.317462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7947a-4400-47ea-8899-4680aa7d65ed admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:50.317765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7947a-4400-47ea-8899-4680aa7d65ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:50.318012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7947a-4400-47ea-8899-4680aa7d65ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:50.318647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7947a-4400-47ea-8899-4680aa7d65ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:50.320215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7947a-4400-47ea-8899-4680aa7d65ed admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:50.321764 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:50.337746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1099/2189] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:50.342441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7ab34-8aff-44ce-bc29-c1113357775a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:50.352988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7ab34-8aff-44ce-bc29-c1113357775a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:50.360156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc303d97-d6c7-4faf-8d55-e75ec3c747f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:50.360888 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc303d97-d6c7-4faf-8d55-e75ec3c747f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:50.361180 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc303d97-d6c7-4faf-8d55-e75ec3c747f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:50.361535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc303d97-d6c7-4faf-8d55-e75ec3c747f1 admin admin] PATH_INFO: `/v3/projects/26c4d68ae3a048389cfdfc1c86d37a09/users/e547ccdff7914bb6b9bbebefbc0f3f7c/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:50.363517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc303d97-d6c7-4faf-8d55-e75ec3c747f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c4d68ae3a048389cfdfc1c86d37a09, user_id=e547ccdff7914bb6b9bbebefbc0f3f7c, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:50.366199 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc303d97-d6c7-4faf-8d55-e75ec3c747f1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:50.377747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1091/2190] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:50 2022] PUT /identity/v3/projects/26c4d68ae3a048389cfdfc1c86d37a09/users/e547ccdff7914bb6b9bbebefbc0f3f7c/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:50.389685 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11785ee-5e94-4b8e-8cb9-5c2bc3c91a23 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:50.390047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11785ee-5e94-4b8e-8cb9-5c2bc3c91a23 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:50.390322 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11785ee-5e94-4b8e-8cb9-5c2bc3c91a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:50.419792 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f11785ee-5e94-4b8e-8cb9-5c2bc3c91a23 None None] MFA Rules not processed for user `e547ccdff7914bb6b9bbebefbc0f3f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:50.421029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f11785ee-5e94-4b8e-8cb9-5c2bc3c91a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:50.490364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1100/2191] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:50.501774 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc303d97-d6c7-4faf-8d55-e75ec3c747f1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:50.503472 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-bc303d97-d6c7-4faf-8d55-e75ec3c747f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:50.559805 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc303d97-d6c7-4faf-8d55-e75ec3c747f1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:50.563404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48d47f-ea4e-452c-8d71-a520589d37e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:50.564003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48d47f-ea4e-452c-8d71-a520589d37e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:50.564283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48d47f-ea4e-452c-8d71-a520589d37e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:50.564586 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48d47f-ea4e-452c-8d71-a520589d37e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:50.573395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48d47f-ea4e-452c-8d71-a520589d37e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:50.574850 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48d47f-ea4e-452c-8d71-a520589d37e6 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:50.584364 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1092/2192] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:50.634594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11785ee-5e94-4b8e-8cb9-5c2bc3c91a23 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:50.636309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f11785ee-5e94-4b8e-8cb9-5c2bc3c91a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:50.648157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11785ee-5e94-4b8e-8cb9-5c2bc3c91a23 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:50.652388 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312453fe-a13b-4b56-b761-4e48c46ce726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:50.653014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312453fe-a13b-4b56-b761-4e48c46ce726 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:50.653293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312453fe-a13b-4b56-b761-4e48c46ce726 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:50.653569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312453fe-a13b-4b56-b761-4e48c46ce726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:50.709043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312453fe-a13b-4b56-b761-4e48c46ce726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:50.710459 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312453fe-a13b-4b56-b761-4e48c46ce726 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:50.719743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1101/2193] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:54.017473 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48d47f-ea4e-452c-8d71-a520589d37e6 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:54.040188 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:54.084611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48d47f-ea4e-452c-8d71-a520589d37e6 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:54.089866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:54.090489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:54.090771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:54.091043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] PATH_INFO: `/v3/users/5c1ee1b08a784ffe902540dd49eed138` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:54.092217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1ee1b08a784ffe902540dd49eed138)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:54.094104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:54.138623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1ee1b08a784ffe902540dd49eed138'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.139280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1ee1b08a784ffe902540dd49eed138'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.145988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1ee1b08a784ffe902540dd49eed138'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.146609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1ee1b08a784ffe902540dd49eed138'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.158808 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1ee1b08a784ffe902540dd49eed138'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.171221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1093/2194] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:42:54 2022] DELETE /identity/v3/users/5c1ee1b08a784ffe902540dd49eed138 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:54.175691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48981434-e856-44ee-9d84-4fefb28a4806 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:54.176178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48981434-e856-44ee-9d84-4fefb28a4806 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:54.176278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48981434-e856-44ee-9d84-4fefb28a4806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:54.194822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-48981434-e856-44ee-9d84-4fefb28a4806 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:54.196011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-48981434-e856-44ee-9d84-4fefb28a4806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:54.255251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1102/2195] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:54.266085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:54.267457 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:54.324556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3efa88-61cd-4947-a1dc-86bbb4d03f8e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:54.328115 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53d40d-3e25-4d50-8978-06562172cd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:54.328750 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d40d-3e25-4d50-8978-06562172cd80 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:54.329025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d40d-3e25-4d50-8978-06562172cd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:54.329296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d40d-3e25-4d50-8978-06562172cd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:54.338117 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53d40d-3e25-4d50-8978-06562172cd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:54.339535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53d40d-3e25-4d50-8978-06562172cd80 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:54.348793 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1094/2196] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:54.632652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48981434-e856-44ee-9d84-4fefb28a4806 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:54.635670 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-48981434-e856-44ee-9d84-4fefb28a4806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:54.649265 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48981434-e856-44ee-9d84-4fefb28a4806 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:54.655261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:54.656155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:54.656583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:54.657019 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] PATH_INFO: `/v3/projects/e8fb01a3799d4da79face1e77b5a99b9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:54.660358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8fb01a3799d4da79face1e77b5a99b9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:54.660358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:54.677886 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:54.713903 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8fb01a3799d4da79face1e77b5a99b9', 'request_id': 'req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.719604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8fb01a3799d4da79face1e77b5a99b9', 'request_id': 'req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.726137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8fb01a3799d4da79face1e77b5a99b9', 'request_id': 'req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.739705 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] The token cache is being invalidate because project e8fb01a3799d4da79face1e77b5a99b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:42:54.739999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.740688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.742178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1103/2197] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:42:54 2022] DELETE /identity/v3/projects/e8fb01a3799d4da79face1e77b5a99b9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:54.746966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53d40d-3e25-4d50-8978-06562172cd80 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:54.760812 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53d40d-3e25-4d50-8978-06562172cd80 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:54.801019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:54.819486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:54.820145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:54.820429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:54.820743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] PATH_INFO: `/v3/users/e547ccdff7914bb6b9bbebefbc0f3f7c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:54.821865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e547ccdff7914bb6b9bbebefbc0f3f7c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:54.823950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:54.868776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e547ccdff7914bb6b9bbebefbc0f3f7c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.870171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e547ccdff7914bb6b9bbebefbc0f3f7c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.877134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e547ccdff7914bb6b9bbebefbc0f3f7c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.877701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e547ccdff7914bb6b9bbebefbc0f3f7c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.889395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-22a4a39b-fb34-4127-910e-8a33d7bda68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e547ccdff7914bb6b9bbebefbc0f3f7c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:54.901908 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1095/2198] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:42:54 2022] DELETE /identity/v3/users/e547ccdff7914bb6b9bbebefbc0f3f7c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:55.184745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:55.186386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:55.203453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab7820-72df-4d12-b2ef-afc3dfda9ed8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:55.264367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:55.265041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.265321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.265596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] PATH_INFO: `/v3/projects/26c4d68ae3a048389cfdfc1c86d37a09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.266724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c4d68ae3a048389cfdfc1c86d37a09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:55.269262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:55.316938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c4d68ae3a048389cfdfc1c86d37a09', 'request_id': 'req-52d7222b-c77f-400f-9b2d-c2dfa777b79e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:55.323827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c4d68ae3a048389cfdfc1c86d37a09', 'request_id': 'req-52d7222b-c77f-400f-9b2d-c2dfa777b79e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:55.330981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c4d68ae3a048389cfdfc1c86d37a09', 'request_id': 'req-52d7222b-c77f-400f-9b2d-c2dfa777b79e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:55.344213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] The token cache is being invalidate because project 26c4d68ae3a048389cfdfc1c86d37a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:42:55.344528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:55.345198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-52d7222b-c77f-400f-9b2d-c2dfa777b79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:42:55.346695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1104/2199] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:42:55 2022] DELETE /identity/v3/projects/26c4d68ae3a048389cfdfc1c86d37a09 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:55.351655 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fedea-1360-4aeb-bfe4-804cf53dad33 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.352124 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fedea-1360-4aeb-bfe4-804cf53dad33 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.352263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fedea-1360-4aeb-bfe4-804cf53dad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.373912 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8c6fedea-1360-4aeb-bfe4-804cf53dad33 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:55.375159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8c6fedea-1360-4aeb-bfe4-804cf53dad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:55.435578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1096/2200] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:55.443822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8fce-5a53-4138-acd8-75a5905474c4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.444111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8fce-5a53-4138-acd8-75a5905474c4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.444382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8fce-5a53-4138-acd8-75a5905474c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.465465 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e22e8fce-5a53-4138-acd8-75a5905474c4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:55.466714 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e22e8fce-5a53-4138-acd8-75a5905474c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:55.474636 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1105/2201] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:42:55.479517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fedea-1360-4aeb-bfe4-804cf53dad33 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:55.489336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fedea-1360-4aeb-bfe4-804cf53dad33 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:55.493910 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bac7a0-aef2-4199-ac6f-0fe743401a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:55.495361 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bac7a0-aef2-4199-ac6f-0fe743401a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.495517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bac7a0-aef2-4199-ac6f-0fe743401a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.495672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bac7a0-aef2-4199-ac6f-0fe743401a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.496318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bac7a0-aef2-4199-ac6f-0fe743401a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:42:55.496656 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bac7a0-aef2-4199-ac6f-0fe743401a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:55.498259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bac7a0-aef2-4199-ac6f-0fe743401a2f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:55.511481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1097/2202] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:42:55.516111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e8fce-5a53-4138-acd8-75a5905474c4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:55.525461 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e8fce-5a53-4138-acd8-75a5905474c4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:55.530268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42bfa1-f4a2-4b1a-9d8e-d70cfa8b0dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:55.530858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42bfa1-f4a2-4b1a-9d8e-d70cfa8b0dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.531134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42bfa1-f4a2-4b1a-9d8e-d70cfa8b0dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.531405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42bfa1-f4a2-4b1a-9d8e-d70cfa8b0dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.532120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42bfa1-f4a2-4b1a-9d8e-d70cfa8b0dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:55.534262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42bfa1-f4a2-4b1a-9d8e-d70cfa8b0dfe admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:55.562985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1106/2203] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:42:55 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:55.567375 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bac7a0-aef2-4199-ac6f-0fe743401a2f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:55.578628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bac7a0-aef2-4199-ac6f-0fe743401a2f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:55.631579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:55.645402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708bdf5-66b2-40f2-9e99-1719323c890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:55.646009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708bdf5-66b2-40f2-9e99-1719323c890a admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.646288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708bdf5-66b2-40f2-9e99-1719323c890a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.646557 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708bdf5-66b2-40f2-9e99-1719323c890a admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.647196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708bdf5-66b2-40f2-9e99-1719323c890a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:55.649150 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708bdf5-66b2-40f2-9e99-1719323c890a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:55.670154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1098/2204] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:42:55 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:55.674473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42bfa1-f4a2-4b1a-9d8e-d70cfa8b0dfe admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:55.680980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:55.685904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42bfa1-f4a2-4b1a-9d8e-d70cfa8b0dfe admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:55.691553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d06eac-37b0-4759-be8b-65dfa2e8e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:55.692169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d06eac-37b0-4759-be8b-65dfa2e8e45e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.692520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d06eac-37b0-4759-be8b-65dfa2e8e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.693020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d06eac-37b0-4759-be8b-65dfa2e8e45e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.693708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d06eac-37b0-4759-be8b-65dfa2e8e45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:55.695319 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d06eac-37b0-4759-be8b-65dfa2e8e45e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:55.705219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1107/2205] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:55.709152 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708bdf5-66b2-40f2-9e99-1719323c890a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:55.719025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708bdf5-66b2-40f2-9e99-1719323c890a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:55.723629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60533611-35dc-42f9-a221-4f8cf5050899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:55.724213 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60533611-35dc-42f9-a221-4f8cf5050899 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.724514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60533611-35dc-42f9-a221-4f8cf5050899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.724788 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60533611-35dc-42f9-a221-4f8cf5050899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.725422 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60533611-35dc-42f9-a221-4f8cf5050899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:55.727005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60533611-35dc-42f9-a221-4f8cf5050899 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:55.739355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1099/2206] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:55.743390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d06eac-37b0-4759-be8b-65dfa2e8e45e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:55.753868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d06eac-37b0-4759-be8b-65dfa2e8e45e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:55.758464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d493eb3-35b0-4f72-a45d-e7e6cfe2d7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:55.759108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d493eb3-35b0-4f72-a45d-e7e6cfe2d7be admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.759395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d493eb3-35b0-4f72-a45d-e7e6cfe2d7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.759671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d493eb3-35b0-4f72-a45d-e7e6cfe2d7be admin admin] PATH_INFO: `/v3/projects/813131c13d7749ee945ec74442d9d1c3/users/94d9bab78bbd4db88800cbfbc8def3ae/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.774778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d493eb3-35b0-4f72-a45d-e7e6cfe2d7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=813131c13d7749ee945ec74442d9d1c3, user_id=94d9bab78bbd4db88800cbfbc8def3ae, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:55.780426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d493eb3-35b0-4f72-a45d-e7e6cfe2d7be admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:55.793208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1108/2207] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:55 2022] PUT /identity/v3/projects/813131c13d7749ee945ec74442d9d1c3/users/94d9bab78bbd4db88800cbfbc8def3ae/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:55.803292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21c02d-47bc-43f3-b50a-0f517ab187d1 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.804249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21c02d-47bc-43f3-b50a-0f517ab187d1 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.804577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21c02d-47bc-43f3-b50a-0f517ab187d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.840233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0b21c02d-47bc-43f3-b50a-0f517ab187d1 None None] MFA Rules not processed for user `94d9bab78bbd4db88800cbfbc8def3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:55.841497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0b21c02d-47bc-43f3-b50a-0f517ab187d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:55.907611 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1100/2208] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:55.912057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d493eb3-35b0-4f72-a45d-e7e6cfe2d7be admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:55.974719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d493eb3-35b0-4f72-a45d-e7e6cfe2d7be admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:55.979652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c352b-fbf4-4eb9-9554-961195481e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:55.980323 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c352b-fbf4-4eb9-9554-961195481e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:55.980715 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c352b-fbf4-4eb9-9554-961195481e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:55.980989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c352b-fbf4-4eb9-9554-961195481e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:55.981627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c352b-fbf4-4eb9-9554-961195481e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:55.983749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c352b-fbf4-4eb9-9554-961195481e24 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.011021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1109/2209] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:42:55 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:42:56.015193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21c02d-47bc-43f3-b50a-0f517ab187d1 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.026195 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21c02d-47bc-43f3-b50a-0f517ab187d1 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.086242 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbc867-1bc1-47d1-aaf1-7c82dbfe5667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.086899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc867-1bc1-47d1-aaf1-7c82dbfe5667 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.087120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc867-1bc1-47d1-aaf1-7c82dbfe5667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.087391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbc867-1bc1-47d1-aaf1-7c82dbfe5667 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.088114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbc867-1bc1-47d1-aaf1-7c82dbfe5667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.090163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbc867-1bc1-47d1-aaf1-7c82dbfe5667 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.115890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1101/2210] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:42:56 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:56.117070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c352b-fbf4-4eb9-9554-961195481e24 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.127985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c352b-fbf4-4eb9-9554-961195481e24 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.133305 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b3402-410b-430c-8c97-1809f9435639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.133934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b3402-410b-430c-8c97-1809f9435639 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.134235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b3402-410b-430c-8c97-1809f9435639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.134508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b3402-410b-430c-8c97-1809f9435639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.135719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b3402-410b-430c-8c97-1809f9435639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.137321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b3402-410b-430c-8c97-1809f9435639 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.148269 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1110/2211] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:42:56.152249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbc867-1bc1-47d1-aaf1-7c82dbfe5667 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.162392 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbc867-1bc1-47d1-aaf1-7c82dbfe5667 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.167734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45709658-83a6-415b-927d-18086a889ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.168324 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45709658-83a6-415b-927d-18086a889ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.168664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45709658-83a6-415b-927d-18086a889ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.168957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45709658-83a6-415b-927d-18086a889ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.169595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45709658-83a6-415b-927d-18086a889ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.171178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45709658-83a6-415b-927d-18086a889ec0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.181376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1102/2212] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:56.186309 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b3402-410b-430c-8c97-1809f9435639 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.196203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b3402-410b-430c-8c97-1809f9435639 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.201002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87e27b-7aa3-4c93-a20c-00bc8afd105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.201646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87e27b-7aa3-4c93-a20c-00bc8afd105b admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.201928 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87e27b-7aa3-4c93-a20c-00bc8afd105b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.202206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87e27b-7aa3-4c93-a20c-00bc8afd105b admin admin] PATH_INFO: `/v3/projects/47e5d2b7ea7c4f42903892ebffc1134a/users/c3396b660fb94861abcc61b49c573d88/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.217208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87e27b-7aa3-4c93-a20c-00bc8afd105b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e5d2b7ea7c4f42903892ebffc1134a, user_id=c3396b660fb94861abcc61b49c573d88, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.219979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87e27b-7aa3-4c93-a20c-00bc8afd105b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.233834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1111/2213] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:56 2022] PUT /identity/v3/projects/47e5d2b7ea7c4f42903892ebffc1134a/users/c3396b660fb94861abcc61b49c573d88/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:42:56.245724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c1573-7997-4724-b5aa-7dfa85e74552 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.246126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c1573-7997-4724-b5aa-7dfa85e74552 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.246406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c1573-7997-4724-b5aa-7dfa85e74552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.275151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-519c1573-7997-4724-b5aa-7dfa85e74552 None None] MFA Rules not processed for user `c3396b660fb94861abcc61b49c573d88`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:56.277212 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-519c1573-7997-4724-b5aa-7dfa85e74552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:56.301351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:56.345133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1103/2214] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:56.349966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87e27b-7aa3-4c93-a20c-00bc8afd105b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.413144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87e27b-7aa3-4c93-a20c-00bc8afd105b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.418584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dda16-bcd5-43f7-9800-0153623a7d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.419190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dda16-bcd5-43f7-9800-0153623a7d81 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.419480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dda16-bcd5-43f7-9800-0153623a7d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.419755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dda16-bcd5-43f7-9800-0153623a7d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.420393 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365dda16-bcd5-43f7-9800-0153623a7d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.422308 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365dda16-bcd5-43f7-9800-0153623a7d81 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.447824 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1112/2215] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:42:56 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:42:56.451959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c1573-7997-4724-b5aa-7dfa85e74552 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.462950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c1573-7997-4724-b5aa-7dfa85e74552 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.524673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b7443-1aaf-4399-befd-2531d93e2716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.525276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b7443-1aaf-4399-befd-2531d93e2716 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.526202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b7443-1aaf-4399-befd-2531d93e2716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.526578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b7443-1aaf-4399-befd-2531d93e2716 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.527255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b7443-1aaf-4399-befd-2531d93e2716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.529201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b7443-1aaf-4399-befd-2531d93e2716 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.550350 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1104/2216] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:42:56 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:42:56.554348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dda16-bcd5-43f7-9800-0153623a7d81 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.561201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:42:56.565116 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dda16-bcd5-43f7-9800-0153623a7d81 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.570959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc0da-916e-4145-91bc-ffcc9f3d0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.571647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc0da-916e-4145-91bc-ffcc9f3d0c60 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.572082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc0da-916e-4145-91bc-ffcc9f3d0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.573066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc0da-916e-4145-91bc-ffcc9f3d0c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.573331 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edc0da-916e-4145-91bc-ffcc9f3d0c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.575029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edc0da-916e-4145-91bc-ffcc9f3d0c60 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.589983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1113/2217] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:42:56.591240 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b7443-1aaf-4399-befd-2531d93e2716 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.601304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b7443-1aaf-4399-befd-2531d93e2716 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.606615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac25a67-5412-4d52-9eed-1fc42ba293fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.607257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac25a67-5412-4d52-9eed-1fc42ba293fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.607534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac25a67-5412-4d52-9eed-1fc42ba293fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.607803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac25a67-5412-4d52-9eed-1fc42ba293fb admin admin] PATH_INFO: `/v3/projects/3724baa6d50e4caf831b99f931f28162/users/66f0d9bef03545e1829be3c2564c18f0/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.622948 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac25a67-5412-4d52-9eed-1fc42ba293fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3724baa6d50e4caf831b99f931f28162, user_id=66f0d9bef03545e1829be3c2564c18f0, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.626006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac25a67-5412-4d52-9eed-1fc42ba293fb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.638251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1105/2218] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:56 2022] PUT /identity/v3/projects/3724baa6d50e4caf831b99f931f28162/users/66f0d9bef03545e1829be3c2564c18f0/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:56.642224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc0da-916e-4145-91bc-ffcc9f3d0c60 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.652879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc0da-916e-4145-91bc-ffcc9f3d0c60 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.708237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05900fd0-4aa2-4783-bede-f21cca613298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.708898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900fd0-4aa2-4783-bede-f21cca613298 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.709248 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900fd0-4aa2-4783-bede-f21cca613298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.709525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900fd0-4aa2-4783-bede-f21cca613298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.710180 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05900fd0-4aa2-4783-bede-f21cca613298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.711739 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05900fd0-4aa2-4783-bede-f21cca613298 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.721780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1114/2219] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:42:56.726008 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac25a67-5412-4d52-9eed-1fc42ba293fb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.736892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac25a67-5412-4d52-9eed-1fc42ba293fb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.741431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979d502-b9f6-4d83-892e-cb372bf856fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.742065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d502-b9f6-4d83-892e-cb372bf856fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.742343 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d502-b9f6-4d83-892e-cb372bf856fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.742617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d502-b9f6-4d83-892e-cb372bf856fd admin admin] PATH_INFO: `/v3/projects/3724baa6d50e4caf831b99f931f28162/users/66f0d9bef03545e1829be3c2564c18f0/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.744858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979d502-b9f6-4d83-892e-cb372bf856fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3724baa6d50e4caf831b99f931f28162, user_id=66f0d9bef03545e1829be3c2564c18f0, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.747544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979d502-b9f6-4d83-892e-cb372bf856fd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.757753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1106/2220] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:42:56 2022] PUT /identity/v3/projects/3724baa6d50e4caf831b99f931f28162/users/66f0d9bef03545e1829be3c2564c18f0/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:42:56.768017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d858f-af99-41ff-a22b-d06da1fa2895 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.768306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d858f-af99-41ff-a22b-d06da1fa2895 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.768621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d858f-af99-41ff-a22b-d06da1fa2895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.797079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0f5d858f-af99-41ff-a22b-d06da1fa2895 None None] MFA Rules not processed for user `66f0d9bef03545e1829be3c2564c18f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:42:56.798280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0f5d858f-af99-41ff-a22b-d06da1fa2895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:56.865940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1115/2221] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:42:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:42:56.877220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979d502-b9f6-4d83-892e-cb372bf856fd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:56.878951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8979d502-b9f6-4d83-892e-cb372bf856fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:56.934924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979d502-b9f6-4d83-892e-cb372bf856fd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:56.938578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ead46-0ec6-4c26-8697-01d96c38bd30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:56.939169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ead46-0ec6-4c26-8697-01d96c38bd30 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:56.939446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ead46-0ec6-4c26-8697-01d96c38bd30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:56.939717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ead46-0ec6-4c26-8697-01d96c38bd30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:56.949155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ead46-0ec6-4c26-8697-01d96c38bd30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:56.950566 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ead46-0ec6-4c26-8697-01d96c38bd30 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:56.959935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1107/2222] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:42:57.002711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d858f-af99-41ff-a22b-d06da1fa2895 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:42:57.004113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0f5d858f-af99-41ff-a22b-d06da1fa2895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:42:57.016653 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d858f-af99-41ff-a22b-d06da1fa2895 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:42:57.020617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e96f26-5efa-4336-8f4c-04a384ebff99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:42:57.021224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e96f26-5efa-4336-8f4c-04a384ebff99 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:42:57.021504 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e96f26-5efa-4336-8f4c-04a384ebff99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:42:57.021775 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e96f26-5efa-4336-8f4c-04a384ebff99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:42:57.078808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e96f26-5efa-4336-8f4c-04a384ebff99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:42:57.080979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e96f26-5efa-4336-8f4c-04a384ebff99 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:42:57.094693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1116/2223] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:42:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:00.028181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ead46-0ec6-4c26-8697-01d96c38bd30 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:00.055377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:00.100327 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ead46-0ec6-4c26-8697-01d96c38bd30 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:00.106087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:00.106797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:00.107082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:00.107365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] PATH_INFO: `/v3/users/94d9bab78bbd4db88800cbfbc8def3ae` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:00.108870 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d9bab78bbd4db88800cbfbc8def3ae)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:00.111047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:00.166844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d9bab78bbd4db88800cbfbc8def3ae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.167512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d9bab78bbd4db88800cbfbc8def3ae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.174652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d9bab78bbd4db88800cbfbc8def3ae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.175296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d9bab78bbd4db88800cbfbc8def3ae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.188651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d9bab78bbd4db88800cbfbc8def3ae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.201794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1108/2224] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:00 2022] DELETE /identity/v3/users/94d9bab78bbd4db88800cbfbc8def3ae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:00.206399 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca685f1-f50f-43a4-b267-375bf0f8dab7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:00.206907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca685f1-f50f-43a4-b267-375bf0f8dab7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:00.207012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca685f1-f50f-43a4-b267-375bf0f8dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:00.225602 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dca685f1-f50f-43a4-b267-375bf0f8dab7 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:00.226784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dca685f1-f50f-43a4-b267-375bf0f8dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:00.235854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:00.286033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1117/2225] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:00.296652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:00.298078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:00.357642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e3943-f41d-44f8-a172-2b771ee079a8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:00.362531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508188fe-6bc9-4c06-8d7a-77323fe2e75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:00.363159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508188fe-6bc9-4c06-8d7a-77323fe2e75c service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:00.363452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508188fe-6bc9-4c06-8d7a-77323fe2e75c service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:00.363754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508188fe-6bc9-4c06-8d7a-77323fe2e75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:00.373349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508188fe-6bc9-4c06-8d7a-77323fe2e75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:00.374779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508188fe-6bc9-4c06-8d7a-77323fe2e75c service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:00.384191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1109/2226] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:00.652787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca685f1-f50f-43a4-b267-375bf0f8dab7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:00.654322 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dca685f1-f50f-43a4-b267-375bf0f8dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:00.667069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca685f1-f50f-43a4-b267-375bf0f8dab7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:00.671793 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:00.672729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:00.673093 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:00.673429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] PATH_INFO: `/v3/projects/813131c13d7749ee945ec74442d9d1c3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:00.674766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813131c13d7749ee945ec74442d9d1c3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:00.677225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:00.724362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813131c13d7749ee945ec74442d9d1c3', 'request_id': 'req-e2549732-63cf-4c12-93ff-60a35ea07546'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.729879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813131c13d7749ee945ec74442d9d1c3', 'request_id': 'req-e2549732-63cf-4c12-93ff-60a35ea07546'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.736368 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813131c13d7749ee945ec74442d9d1c3', 'request_id': 'req-e2549732-63cf-4c12-93ff-60a35ea07546'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.748690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] The token cache is being invalidate because project 813131c13d7749ee945ec74442d9d1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:00.748982 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.749633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.751113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1118/2227] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:00 2022] DELETE /identity/v3/projects/813131c13d7749ee945ec74442d9d1c3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:00.755123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508188fe-6bc9-4c06-8d7a-77323fe2e75c service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:00.765141 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508188fe-6bc9-4c06-8d7a-77323fe2e75c service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:00.803992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:00.821877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:00.823021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:00.823300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:00.823623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] PATH_INFO: `/v3/users/c3396b660fb94861abcc61b49c573d88` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:00.824892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3396b660fb94861abcc61b49c573d88)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:00.826763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:00.875623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3396b660fb94861abcc61b49c573d88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.876264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3396b660fb94861abcc61b49c573d88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.882934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3396b660fb94861abcc61b49c573d88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.883556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3396b660fb94861abcc61b49c573d88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.895762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3396b660fb94861abcc61b49c573d88'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:00.908610 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1110/2228] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:00 2022] DELETE /identity/v3/users/c3396b660fb94861abcc61b49c573d88 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:01.173347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:01.174853 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:01.189646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2549732-63cf-4c12-93ff-60a35ea07546 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:01.262887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:01.263517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:01.263957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:01.264158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] PATH_INFO: `/v3/projects/47e5d2b7ea7c4f42903892ebffc1134a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:01.265308 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e5d2b7ea7c4f42903892ebffc1134a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:01.267182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:01.308626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:01.317711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e5d2b7ea7c4f42903892ebffc1134a', 'request_id': 'req-9593b7df-f021-4f4b-a80c-f00099ce1668'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.325112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e5d2b7ea7c4f42903892ebffc1134a', 'request_id': 'req-9593b7df-f021-4f4b-a80c-f00099ce1668'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.331497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e5d2b7ea7c4f42903892ebffc1134a', 'request_id': 'req-9593b7df-f021-4f4b-a80c-f00099ce1668'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.345098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] The token cache is being invalidate because project 47e5d2b7ea7c4f42903892ebffc1134a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:01.345386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.346051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.347890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1119/2229] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:01 2022] DELETE /identity/v3/projects/47e5d2b7ea7c4f42903892ebffc1134a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:01.352454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:01.354009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:01.367541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fd049-5d94-4368-9c99-05a0f7fff94c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:01.437518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:01.438160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:01.438500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:01.438782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] PATH_INFO: `/v3/users/66f0d9bef03545e1829be3c2564c18f0` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:01.439911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f0d9bef03545e1829be3c2564c18f0)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:01.441877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:01.497975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f0d9bef03545e1829be3c2564c18f0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.498623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f0d9bef03545e1829be3c2564c18f0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.505778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f0d9bef03545e1829be3c2564c18f0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.506414 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f0d9bef03545e1829be3c2564c18f0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.512976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:01.522997 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5d032328-a1f8-4915-a7f7-6048b1b6e07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f0d9bef03545e1829be3c2564c18f0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.538703 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1111/2230] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:01 2022] DELETE /identity/v3/users/66f0d9bef03545e1829be3c2564c18f0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:01.817780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:01.819214 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:01.832934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593b7df-f021-4f4b-a80c-f00099ce1668 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:01.896591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:01.897284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:01.897677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:01.897962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] PATH_INFO: `/v3/projects/3724baa6d50e4caf831b99f931f28162` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:01.899090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3724baa6d50e4caf831b99f931f28162)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:01.901307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:01.945932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3724baa6d50e4caf831b99f931f28162', 'request_id': 'req-2be75f06-6fb9-4522-a534-314af38b45d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.952209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3724baa6d50e4caf831b99f931f28162', 'request_id': 'req-2be75f06-6fb9-4522-a534-314af38b45d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.958539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3724baa6d50e4caf831b99f931f28162', 'request_id': 'req-2be75f06-6fb9-4522-a534-314af38b45d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.970394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] The token cache is being invalidate because project 3724baa6d50e4caf831b99f931f28162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:01.970683 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.971304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2be75f06-6fb9-4522-a534-314af38b45d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:01.972818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1120/2231] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:01 2022] DELETE /identity/v3/projects/3724baa6d50e4caf831b99f931f28162 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:01.978780 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd527-5730-4110-a28f-1d83b7ab7f6e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:01.979066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd527-5730-4110-a28f-1d83b7ab7f6e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:01.979391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd527-5730-4110-a28f-1d83b7ab7f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:01.999789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-93ddd527-5730-4110-a28f-1d83b7ab7f6e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:02.001027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-93ddd527-5730-4110-a28f-1d83b7ab7f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:02.061635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1112/2232] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:02.071103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e4b6-be18-4d1b-ba3c-3b0ba5f486a3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.071390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e4b6-be18-4d1b-ba3c-3b0ba5f486a3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.071663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e4b6-be18-4d1b-ba3c-3b0ba5f486a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.091395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9311e4b6-be18-4d1b-ba3c-3b0ba5f486a3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:02.092609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9311e4b6-be18-4d1b-ba3c-3b0ba5f486a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:02.100262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1121/2233] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:02.104545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddd527-5730-4110-a28f-1d83b7ab7f6e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.114395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddd527-5730-4110-a28f-1d83b7ab7f6e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.119734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc311a-be85-4693-8732-dc1a2b718866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.120361 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc311a-be85-4693-8732-dc1a2b718866 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.120672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc311a-be85-4693-8732-dc1a2b718866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.120951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc311a-be85-4693-8732-dc1a2b718866 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.121601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc311a-be85-4693-8732-dc1a2b718866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:02.121903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc311a-be85-4693-8732-dc1a2b718866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.123523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc311a-be85-4693-8732-dc1a2b718866 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.135649 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1113/2234] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:43:02.139836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311e4b6-be18-4d1b-ba3c-3b0ba5f486a3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.148966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311e4b6-be18-4d1b-ba3c-3b0ba5f486a3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.153545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062b843-f252-4506-9d8e-6bac2e38c173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.154128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062b843-f252-4506-9d8e-6bac2e38c173 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.154407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062b843-f252-4506-9d8e-6bac2e38c173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.154675 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062b843-f252-4506-9d8e-6bac2e38c173 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.155290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062b843-f252-4506-9d8e-6bac2e38c173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.157197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062b843-f252-4506-9d8e-6bac2e38c173 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.185213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1122/2235] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:02 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:02.189192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc311a-be85-4693-8732-dc1a2b718866 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.198966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc311a-be85-4693-8732-dc1a2b718866 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.254983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cb541-f4b2-4d56-b9d1-c86dda9380a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.255583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb541-f4b2-4d56-b9d1-c86dda9380a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.255867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb541-f4b2-4d56-b9d1-c86dda9380a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.256139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb541-f4b2-4d56-b9d1-c86dda9380a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.256802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cb541-f4b2-4d56-b9d1-c86dda9380a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.258720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cb541-f4b2-4d56-b9d1-c86dda9380a1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.279736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1114/2236] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:02 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:02.283870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062b843-f252-4506-9d8e-6bac2e38c173 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.294544 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062b843-f252-4506-9d8e-6bac2e38c173 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.299270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d04e2-4ff9-4f31-b22a-dab8a1f7118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.299857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d04e2-4ff9-4f31-b22a-dab8a1f7118b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.300135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d04e2-4ff9-4f31-b22a-dab8a1f7118b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.300405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d04e2-4ff9-4f31-b22a-dab8a1f7118b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.301075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d04e2-4ff9-4f31-b22a-dab8a1f7118b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.302628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d04e2-4ff9-4f31-b22a-dab8a1f7118b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.313041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1123/2237] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:02.316926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cb541-f4b2-4d56-b9d1-c86dda9380a1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.326912 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cb541-f4b2-4d56-b9d1-c86dda9380a1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.331503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979afae-5fee-4c51-9b20-5119a7d79564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.332093 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979afae-5fee-4c51-9b20-5119a7d79564 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.332373 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979afae-5fee-4c51-9b20-5119a7d79564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.332679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979afae-5fee-4c51-9b20-5119a7d79564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.333318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979afae-5fee-4c51-9b20-5119a7d79564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.334897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979afae-5fee-4c51-9b20-5119a7d79564 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.345873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1115/2238] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:02.349661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d04e2-4ff9-4f31-b22a-dab8a1f7118b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.360176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d04e2-4ff9-4f31-b22a-dab8a1f7118b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.364716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79986e9c-0512-4f9b-b53d-ef2868f1e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.365353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79986e9c-0512-4f9b-b53d-ef2868f1e98a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.365630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79986e9c-0512-4f9b-b53d-ef2868f1e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.365900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79986e9c-0512-4f9b-b53d-ef2868f1e98a admin admin] PATH_INFO: `/v3/projects/7ff7706e993d45088d01108ea5454eb8/users/c3dabfde1e0648e98902b9dd71632e49/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.381132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79986e9c-0512-4f9b-b53d-ef2868f1e98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff7706e993d45088d01108ea5454eb8, user_id=c3dabfde1e0648e98902b9dd71632e49, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.383738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79986e9c-0512-4f9b-b53d-ef2868f1e98a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.385998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:02.397870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1124/2239] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:02 2022] PUT /identity/v3/projects/7ff7706e993d45088d01108ea5454eb8/users/c3dabfde1e0648e98902b9dd71632e49/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:02.409341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd0734-c7c1-4897-93d1-d229aa630885 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.409837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd0734-c7c1-4897-93d1-d229aa630885 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.409837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd0734-c7c1-4897-93d1-d229aa630885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.438519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-1dbd0734-c7c1-4897-93d1-d229aa630885 None None] MFA Rules not processed for user `c3dabfde1e0648e98902b9dd71632e49`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:02.439714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1dbd0734-c7c1-4897-93d1-d229aa630885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:02.471720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:02.503590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1116/2240] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:02.508087 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79986e9c-0512-4f9b-b53d-ef2868f1e98a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.570339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79986e9c-0512-4f9b-b53d-ef2868f1e98a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.575095 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fc2f3-2f8c-4153-b290-ef0692b97123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.575728 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fc2f3-2f8c-4153-b290-ef0692b97123 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.576008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fc2f3-2f8c-4153-b290-ef0692b97123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.576276 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fc2f3-2f8c-4153-b290-ef0692b97123 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.576948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fc2f3-2f8c-4153-b290-ef0692b97123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.578830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fc2f3-2f8c-4153-b290-ef0692b97123 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.610876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1125/2241] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:02 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:02.612174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd0734-c7c1-4897-93d1-d229aa630885 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.623752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd0734-c7c1-4897-93d1-d229aa630885 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.683885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4b2dd-b686-4c95-b0e2-da8d8d2896da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.684533 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4b2dd-b686-4c95-b0e2-da8d8d2896da admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.684818 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4b2dd-b686-4c95-b0e2-da8d8d2896da admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.685121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4b2dd-b686-4c95-b0e2-da8d8d2896da admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.685760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4b2dd-b686-4c95-b0e2-da8d8d2896da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.687689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4b2dd-b686-4c95-b0e2-da8d8d2896da admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.714069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1117/2242] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:02 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:02.719814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fc2f3-2f8c-4153-b290-ef0692b97123 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.731556 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fc2f3-2f8c-4153-b290-ef0692b97123 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.737672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d842c5f-c765-4ba4-a27f-4b23947f47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.738270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d842c5f-c765-4ba4-a27f-4b23947f47fe admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.738552 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d842c5f-c765-4ba4-a27f-4b23947f47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.738824 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d842c5f-c765-4ba4-a27f-4b23947f47fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.739491 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d842c5f-c765-4ba4-a27f-4b23947f47fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.741097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d842c5f-c765-4ba4-a27f-4b23947f47fe admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.751871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1126/2243] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:02.756149 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4b2dd-b686-4c95-b0e2-da8d8d2896da admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.766854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4b2dd-b686-4c95-b0e2-da8d8d2896da admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.771777 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea25ff-1bd8-443d-95e1-d1ec0c1b713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.772439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea25ff-1bd8-443d-95e1-d1ec0c1b713c admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.772760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea25ff-1bd8-443d-95e1-d1ec0c1b713c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.773039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea25ff-1bd8-443d-95e1-d1ec0c1b713c admin admin] PATH_INFO: `/v3/projects/f5ab08485b9d46a98639c3083c526ef1/users/985dee2c7d8648208752e01ffc505fcd/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.790815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea25ff-1bd8-443d-95e1-d1ec0c1b713c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ab08485b9d46a98639c3083c526ef1, user_id=985dee2c7d8648208752e01ffc505fcd, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.794111 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea25ff-1bd8-443d-95e1-d1ec0c1b713c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.809169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1118/2244] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:02 2022] PUT /identity/v3/projects/f5ab08485b9d46a98639c3083c526ef1/users/985dee2c7d8648208752e01ffc505fcd/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:02.813056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d842c5f-c765-4ba4-a27f-4b23947f47fe admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.823726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d842c5f-c765-4ba4-a27f-4b23947f47fe admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.888599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19854b3-69fc-47bb-bca7-aa03a8f7456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.889233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19854b3-69fc-47bb-bca7-aa03a8f7456a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.889515 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19854b3-69fc-47bb-bca7-aa03a8f7456a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.889788 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19854b3-69fc-47bb-bca7-aa03a8f7456a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.890429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19854b3-69fc-47bb-bca7-aa03a8f7456a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.892041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19854b3-69fc-47bb-bca7-aa03a8f7456a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.903034 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1127/2245] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:02.907636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea25ff-1bd8-443d-95e1-d1ec0c1b713c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:02.918923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea25ff-1bd8-443d-95e1-d1ec0c1b713c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:02.923810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf5800-2c4d-43cf-af31-94e612eb87e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:02.924437 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5800-2c4d-43cf-af31-94e612eb87e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.924752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5800-2c4d-43cf-af31-94e612eb87e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.925027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5800-2c4d-43cf-af31-94e612eb87e7 admin admin] PATH_INFO: `/v3/projects/f5ab08485b9d46a98639c3083c526ef1/users/985dee2c7d8648208752e01ffc505fcd/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.927015 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf5800-2c4d-43cf-af31-94e612eb87e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ab08485b9d46a98639c3083c526ef1, user_id=985dee2c7d8648208752e01ffc505fcd, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:02.930283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf5800-2c4d-43cf-af31-94e612eb87e7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:02.940935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1119/2246] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:02 2022] PUT /identity/v3/projects/f5ab08485b9d46a98639c3083c526ef1/users/985dee2c7d8648208752e01ffc505fcd/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:02.952219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c63a-18d3-4252-b72f-2db2618371c0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:02.952539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c63a-18d3-4252-b72f-2db2618371c0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:02.952823 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c63a-18d3-4252-b72f-2db2618371c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:02.982605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5c50c63a-18d3-4252-b72f-2db2618371c0 None None] MFA Rules not processed for user `985dee2c7d8648208752e01ffc505fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:02.984048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5c50c63a-18d3-4252-b72f-2db2618371c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:03.034422 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:03.054858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1128/2247] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:03.067114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf5800-2c4d-43cf-af31-94e612eb87e7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:03.068927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-dbbf5800-2c4d-43cf-af31-94e612eb87e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:03.125852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf5800-2c4d-43cf-af31-94e612eb87e7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:03.131776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be021b-cb1e-4830-bb3c-78d2547c6299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:03.132962 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be021b-cb1e-4830-bb3c-78d2547c6299 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:03.133557 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be021b-cb1e-4830-bb3c-78d2547c6299 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:03.134043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be021b-cb1e-4830-bb3c-78d2547c6299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:03.145099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be021b-cb1e-4830-bb3c-78d2547c6299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:03.146518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be021b-cb1e-4830-bb3c-78d2547c6299 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:03.156355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1120/2248] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:43:03.230078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50c63a-18d3-4252-b72f-2db2618371c0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:03.239801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50c63a-18d3-4252-b72f-2db2618371c0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:03.243401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf94fc-bbd8-4c89-97b9-55b30e13d4ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:03.244510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf94fc-bbd8-4c89-97b9-55b30e13d4ca service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:03.244792 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf94fc-bbd8-4c89-97b9-55b30e13d4ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:03.245059 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf94fc-bbd8-4c89-97b9-55b30e13d4ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:03.299833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf94fc-bbd8-4c89-97b9-55b30e13d4ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:03.301280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf94fc-bbd8-4c89-97b9-55b30e13d4ca service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:03.310496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1129/2249] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:03.570740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be021b-cb1e-4830-bb3c-78d2547c6299 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:03.603417 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:03.634443 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be021b-cb1e-4830-bb3c-78d2547c6299 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:03.639485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:03.640106 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:03.640385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:03.640682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] PATH_INFO: `/v3/users/c3dabfde1e0648e98902b9dd71632e49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:03.641783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3dabfde1e0648e98902b9dd71632e49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:03.643681 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:03.687644 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3dabfde1e0648e98902b9dd71632e49'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:03.688209 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3dabfde1e0648e98902b9dd71632e49'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:03.695034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3dabfde1e0648e98902b9dd71632e49'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:03.695643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3dabfde1e0648e98902b9dd71632e49'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:03.707328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3dabfde1e0648e98902b9dd71632e49'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:03.719137 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1121/2250] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:03 2022] DELETE /identity/v3/users/c3dabfde1e0648e98902b9dd71632e49 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:03.723770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb817-c826-44ac-8b0e-55492c693676 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:03.724075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb817-c826-44ac-8b0e-55492c693676 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:03.724359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb817-c826-44ac-8b0e-55492c693676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:03.743830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c41bb817-c826-44ac-8b0e-55492c693676 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:03.745791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c41bb817-c826-44ac-8b0e-55492c693676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:03.803490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1130/2251] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:03.813924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:03.815296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:03.874043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc784-ef33-4092-a299-069183abc99a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:03.877666 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9e101-eac9-49d5-ae0e-5c6cfefd8fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:03.878271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9e101-eac9-49d5-ae0e-5c6cfefd8fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:03.878556 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9e101-eac9-49d5-ae0e-5c6cfefd8fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:03.878833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9e101-eac9-49d5-ae0e-5c6cfefd8fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:03.888274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9e101-eac9-49d5-ae0e-5c6cfefd8fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:03.889560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9e101-eac9-49d5-ae0e-5c6cfefd8fc5 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:03.899168 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1122/2252] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:04.183123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb817-c826-44ac-8b0e-55492c693676 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:04.184683 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c41bb817-c826-44ac-8b0e-55492c693676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:04.201110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb817-c826-44ac-8b0e-55492c693676 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:04.209479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:04.210429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:04.210953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:04.211376 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] PATH_INFO: `/v3/projects/7ff7706e993d45088d01108ea5454eb8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:04.213120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff7706e993d45088d01108ea5454eb8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:04.215660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:04.270854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff7706e993d45088d01108ea5454eb8', 'request_id': 'req-4ddff04c-b41e-493f-a825-a67cdfc3d334'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.279273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff7706e993d45088d01108ea5454eb8', 'request_id': 'req-4ddff04c-b41e-493f-a825-a67cdfc3d334'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.279474 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9e101-eac9-49d5-ae0e-5c6cfefd8fc5 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:04.280897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2ab9e101-eac9-49d5-ae0e-5c6cfefd8fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:04.286007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff7706e993d45088d01108ea5454eb8', 'request_id': 'req-4ddff04c-b41e-493f-a825-a67cdfc3d334'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.294263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9e101-eac9-49d5-ae0e-5c6cfefd8fc5 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:04.299767 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] The token cache is being invalidate because project 7ff7706e993d45088d01108ea5454eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:04.300058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.300919 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.302396 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1131/2253] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:04 2022] DELETE /identity/v3/projects/7ff7706e993d45088d01108ea5454eb8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:04.306900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:04.308636 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:04.323755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:04.346783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:04.357463 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:04.358274 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:04.358810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:04.359089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] PATH_INFO: `/v3/users/07e60203f2564180bb14af52556bafea` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:04.360287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e60203f2564180bb14af52556bafea)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:04.362249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:04.379271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddff04c-b41e-493f-a825-a67cdfc3d334 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:04.383973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:04.385278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:04.385565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:04.385843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] PATH_INFO: `/v3/users/985dee2c7d8648208752e01ffc505fcd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:04.387036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=985dee2c7d8648208752e01ffc505fcd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:04.389400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:04.410630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e60203f2564180bb14af52556bafea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.411291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e60203f2564180bb14af52556bafea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.421296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e60203f2564180bb14af52556bafea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.422163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e60203f2564180bb14af52556bafea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.435615 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-db5e1f78-92ad-456f-a982-5956602e4b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e60203f2564180bb14af52556bafea'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.441250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985dee2c7d8648208752e01ffc505fcd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.442060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985dee2c7d8648208752e01ffc505fcd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.448380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1123/2254] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:04 2022] DELETE /identity/v3/users/07e60203f2564180bb14af52556bafea => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:04.451697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985dee2c7d8648208752e01ffc505fcd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.453251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0e30-b062-4675-b504-c1d8e1a87ec9 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:04.453478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0e30-b062-4675-b504-c1d8e1a87ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:04.453758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0e30-b062-4675-b504-c1d8e1a87ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:04.457899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985dee2c7d8648208752e01ffc505fcd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.458681 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985dee2c7d8648208752e01ffc505fcd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.473404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3a3d0e30-b062-4675-b504-c1d8e1a87ec9 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:04.474746 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3a3d0e30-b062-4675-b504-c1d8e1a87ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:04.477721 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1132/2255] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:04 2022] DELETE /identity/v3/users/985dee2c7d8648208752e01ffc505fcd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:04.538162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1124/2256] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:04.549090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:04.550575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:04.611302 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f989ea5-9f1e-47f2-ae56-1a39e3de82ab admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:04.614989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcafee-1f35-46cb-a968-f2c182fd773d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:04.615598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcafee-1f35-46cb-a968-f2c182fd773d service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:04.615902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcafee-1f35-46cb-a968-f2c182fd773d service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:04.616178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcafee-1f35-46cb-a968-f2c182fd773d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:04.666216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:04.685577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcafee-1f35-46cb-a968-f2c182fd773d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:04.687123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcafee-1f35-46cb-a968-f2c182fd773d service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:04.696901 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1133/2257] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:04.792067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0e30-b062-4675-b504-c1d8e1a87ec9 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:04.793631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3a3d0e30-b062-4675-b504-c1d8e1a87ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:04.805978 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0e30-b062-4675-b504-c1d8e1a87ec9 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:04.813250 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:04.814385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:04.814519 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:04.814839 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] PATH_INFO: `/v3/projects/f5ab08485b9d46a98639c3083c526ef1` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:04.816050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ab08485b9d46a98639c3083c526ef1)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:04.818263 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:04.872761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ab08485b9d46a98639c3083c526ef1', 'request_id': 'req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.880283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ab08485b9d46a98639c3083c526ef1', 'request_id': 'req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.886663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ab08485b9d46a98639c3083c526ef1', 'request_id': 'req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.888904 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:04.903315 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] The token cache is being invalidate because project f5ab08485b9d46a98639c3083c526ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:04.903754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.904968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a1cb1291-79eb-4165-adb8-a06efb9f2ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:04.907174 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1125/2258] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:04 2022] DELETE /identity/v3/projects/f5ab08485b9d46a98639c3083c526ef1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:04.911810 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6a1d1-c6e5-4124-b7e8-6827fc13e69d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:04.912094 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6a1d1-c6e5-4124-b7e8-6827fc13e69d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:04.912370 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6a1d1-c6e5-4124-b7e8-6827fc13e69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:04.933990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-45d6a1d1-c6e5-4124-b7e8-6827fc13e69d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:04.935197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-45d6a1d1-c6e5-4124-b7e8-6827fc13e69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:04.997296 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1134/2259] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:05.005969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c861729-7b6d-4190-9715-2c9893ad871d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.006255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c861729-7b6d-4190-9715-2c9893ad871d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.006531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c861729-7b6d-4190-9715-2c9893ad871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.027925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5c861729-7b6d-4190-9715-2c9893ad871d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:05.029280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5c861729-7b6d-4190-9715-2c9893ad871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.029932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6a1d1-c6e5-4124-b7e8-6827fc13e69d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.031304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-45d6a1d1-c6e5-4124-b7e8-6827fc13e69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.039447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1126/2260] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:05.046854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c861729-7b6d-4190-9715-2c9893ad871d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.057622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6a1d1-c6e5-4124-b7e8-6827fc13e69d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.058477 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c861729-7b6d-4190-9715-2c9893ad871d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.064408 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7bfe0-18df-47f7-bff2-41330c5d66f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.064590 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.065179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7bfe0-18df-47f7-bff2-41330c5d66f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.065300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.065459 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7bfe0-18df-47f7-bff2-41330c5d66f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.065564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.065725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] PATH_INFO: `/v3/projects/618a76ce167640c48f6272f01c6207d7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.065824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7bfe0-18df-47f7-bff2-41330c5d66f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.066376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7bfe0-18df-47f7-bff2-41330c5d66f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:05.066675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7bfe0-18df-47f7-bff2-41330c5d66f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.066859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618a76ce167640c48f6272f01c6207d7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.068261 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7bfe0-18df-47f7-bff2-41330c5d66f0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.068799 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.081309 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1127/2261] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:43:05.085457 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7bfe0-18df-47f7-bff2-41330c5d66f0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.095960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7bfe0-18df-47f7-bff2-41330c5d66f0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.101084 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a1735-4e6f-44be-aadb-2b39587cebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.101665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1735-4e6f-44be-aadb-2b39587cebbd admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.101943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1735-4e6f-44be-aadb-2b39587cebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.102212 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1735-4e6f-44be-aadb-2b39587cebbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.102836 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a1735-4e6f-44be-aadb-2b39587cebbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.105438 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a1735-4e6f-44be-aadb-2b39587cebbd admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.118554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618a76ce167640c48f6272f01c6207d7', 'request_id': 'req-e86e8096-6a3a-4b80-bb6c-d63e830481b2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.127233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618a76ce167640c48f6272f01c6207d7', 'request_id': 'req-e86e8096-6a3a-4b80-bb6c-d63e830481b2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.134178 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618a76ce167640c48f6272f01c6207d7', 'request_id': 'req-e86e8096-6a3a-4b80-bb6c-d63e830481b2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.136296 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1128/2262] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:05 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:05.140739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a1735-4e6f-44be-aadb-2b39587cebbd admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.148582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] The token cache is being invalidate because project 618a76ce167640c48f6272f01c6207d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:05.148959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.149678 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.151991 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1135/2263] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:05 2022] DELETE /identity/v3/projects/618a76ce167640c48f6272f01c6207d7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:05.155861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.157312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.206329 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a1735-4e6f-44be-aadb-2b39587cebbd admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.211117 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7b8b8-fb4b-4136-83be-1467cf656315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.211825 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7b8b8-fb4b-4136-83be-1467cf656315 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.212172 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7b8b8-fb4b-4136-83be-1467cf656315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.212444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7b8b8-fb4b-4136-83be-1467cf656315 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.213842 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7b8b8-fb4b-4136-83be-1467cf656315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.215766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7b8b8-fb4b-4136-83be-1467cf656315 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.226437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e8096-6a3a-4b80-bb6c-d63e830481b2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.231440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.232065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.232439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.232650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] PATH_INFO: `/v3/users/491b68c51f3e44e69f1b0673bbf8915f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.234044 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=491b68c51f3e44e69f1b0673bbf8915f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.235947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.240720 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:05.240884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1129/2264] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:05 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:05.245509 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7b8b8-fb4b-4136-83be-1467cf656315 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.247351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-36c7b8b8-fb4b-4136-83be-1467cf656315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.260346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7b8b8-fb4b-4136-83be-1467cf656315 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.265959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b69863-3634-4a59-a7a3-504485420e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.266544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b69863-3634-4a59-a7a3-504485420e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.266826 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b69863-3634-4a59-a7a3-504485420e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.267095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b69863-3634-4a59-a7a3-504485420e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.267735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b69863-3634-4a59-a7a3-504485420e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.269345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b69863-3634-4a59-a7a3-504485420e93 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.283105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1130/2265] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:05.284495 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b69863-3634-4a59-a7a3-504485420e93 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.286963 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491b68c51f3e44e69f1b0673bbf8915f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.287656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491b68c51f3e44e69f1b0673bbf8915f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.294258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b69863-3634-4a59-a7a3-504485420e93 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.294676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491b68c51f3e44e69f1b0673bbf8915f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.298980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aea78-53d8-4444-a2b3-43c44aa4d6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.299517 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aea78-53d8-4444-a2b3-43c44aa4d6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.299843 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aea78-53d8-4444-a2b3-43c44aa4d6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.300095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aea78-53d8-4444-a2b3-43c44aa4d6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.300715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aea78-53d8-4444-a2b3-43c44aa4d6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.302278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aea78-53d8-4444-a2b3-43c44aa4d6c4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.302452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491b68c51f3e44e69f1b0673bbf8915f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.303157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b353192f-8a4c-4765-9446-4659bff697fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491b68c51f3e44e69f1b0673bbf8915f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.312714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1131/2266] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:05.316741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aea78-53d8-4444-a2b3-43c44aa4d6c4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.318914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-983aea78-53d8-4444-a2b3-43c44aa4d6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.324600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1136/2267] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:05 2022] DELETE /identity/v3/users/491b68c51f3e44e69f1b0673bbf8915f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:05.334119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aea78-53d8-4444-a2b3-43c44aa4d6c4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.393882 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4a69-dc5d-4169-9974-88d29521d5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.394923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4a69-dc5d-4169-9974-88d29521d5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.395325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4a69-dc5d-4169-9974-88d29521d5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.395625 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4a69-dc5d-4169-9974-88d29521d5a7 admin admin] PATH_INFO: `/v3/projects/beb10610ba4346b2ab4373afeb7e185e/users/6576e7cb9af748ebbe8c5bda578c2977/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.411735 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c4a69-dc5d-4169-9974-88d29521d5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb10610ba4346b2ab4373afeb7e185e, user_id=6576e7cb9af748ebbe8c5bda578c2977, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.414541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c4a69-dc5d-4169-9974-88d29521d5a7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.427182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1132/2268] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:05 2022] PUT /identity/v3/projects/beb10610ba4346b2ab4373afeb7e185e/users/6576e7cb9af748ebbe8c5bda578c2977/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:05.437795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0004d-c248-4d66-aa10-4e3fe057586f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.438086 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0004d-c248-4d66-aa10-4e3fe057586f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.438373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0004d-c248-4d66-aa10-4e3fe057586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.469215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4cc0004d-c248-4d66-aa10-4e3fe057586f None None] MFA Rules not processed for user `6576e7cb9af748ebbe8c5bda578c2977`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:05.470448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4cc0004d-c248-4d66-aa10-4e3fe057586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.542887 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1137/2269] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:05.553960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4a69-dc5d-4169-9974-88d29521d5a7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.555802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-880c4a69-dc5d-4169-9974-88d29521d5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.564697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:05.609955 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0004d-c248-4d66-aa10-4e3fe057586f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.611668 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4cc0004d-c248-4d66-aa10-4e3fe057586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.630299 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4a69-dc5d-4169-9974-88d29521d5a7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.635674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f5006-3ce3-4440-abe4-23e8d0e95331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.636483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5006-3ce3-4440-abe4-23e8d0e95331 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.636679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5006-3ce3-4440-abe4-23e8d0e95331 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.637042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5006-3ce3-4440-abe4-23e8d0e95331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.648762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f5006-3ce3-4440-abe4-23e8d0e95331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.650622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f5006-3ce3-4440-abe4-23e8d0e95331 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.660963 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1133/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:05.680338 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f5006-3ce3-4440-abe4-23e8d0e95331 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.695000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0004d-c248-4d66-aa10-4e3fe057586f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.700736 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.701510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.701855 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.702215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] PATH_INFO: `/v3/projects/f78d4fbbbefc40c2adaec59fcf6fc4c3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.703412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78d4fbbbefc40c2adaec59fcf6fc4c3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.705401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.722574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:05.744344 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f5006-3ce3-4440-abe4-23e8d0e95331 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.757231 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78d4fbbbefc40c2adaec59fcf6fc4c3', 'request_id': 'req-850c2cc6-e4a7-4757-8488-d458aaf0e742'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.763534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78d4fbbbefc40c2adaec59fcf6fc4c3', 'request_id': 'req-850c2cc6-e4a7-4757-8488-d458aaf0e742'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.769855 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78d4fbbbefc40c2adaec59fcf6fc4c3', 'request_id': 'req-850c2cc6-e4a7-4757-8488-d458aaf0e742'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.782933 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] The token cache is being invalidate because project f78d4fbbbefc40c2adaec59fcf6fc4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:05.783223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.783865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-850c2cc6-e4a7-4757-8488-d458aaf0e742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.785464 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1138/2271] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:05 2022] DELETE /identity/v3/projects/f78d4fbbbefc40c2adaec59fcf6fc4c3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:05.790126 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b5d62-2e58-4093-b154-00c9a50aa296 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.790411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b5d62-2e58-4093-b154-00c9a50aa296 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.790741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b5d62-2e58-4093-b154-00c9a50aa296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.803181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.803809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.804090 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.804360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] PATH_INFO: `/v3/users/6576e7cb9af748ebbe8c5bda578c2977` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.805518 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6576e7cb9af748ebbe8c5bda578c2977)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.807952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.815197 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c44b5d62-2e58-4093-b154-00c9a50aa296 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:05.816399 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c44b5d62-2e58-4093-b154-00c9a50aa296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.827417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1139/2272] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:05.837426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dbf5c-2146-4a4b-9180-1fe53ebf8800 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.839610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dbf5c-2146-4a4b-9180-1fe53ebf8800 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.839928 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dbf5c-2146-4a4b-9180-1fe53ebf8800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.857120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6576e7cb9af748ebbe8c5bda578c2977'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.857772 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6576e7cb9af748ebbe8c5bda578c2977'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.860452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7f4dbf5c-2146-4a4b-9180-1fe53ebf8800 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:05.861697 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7f4dbf5c-2146-4a4b-9180-1fe53ebf8800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.865148 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6576e7cb9af748ebbe8c5bda578c2977'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.865792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6576e7cb9af748ebbe8c5bda578c2977'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.867010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:05.871797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1140/2273] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:05.876008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dbf5c-2146-4a4b-9180-1fe53ebf8800 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.881030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c8a6451d-35be-462e-949c-4d2d2929a72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6576e7cb9af748ebbe8c5bda578c2977'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:05.886106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dbf5c-2146-4a4b-9180-1fe53ebf8800 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.890961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4826b-c742-4ded-9ed2-cba5554e88e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.891557 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4826b-c742-4ded-9ed2-cba5554e88e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.891836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4826b-c742-4ded-9ed2-cba5554e88e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.892108 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4826b-c742-4ded-9ed2-cba5554e88e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.892798 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4826b-c742-4ded-9ed2-cba5554e88e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:05.893104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4826b-c742-4ded-9ed2-cba5554e88e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.894691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4826b-c742-4ded-9ed2-cba5554e88e7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.895916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1134/2274] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:05 2022] DELETE /identity/v3/users/6576e7cb9af748ebbe8c5bda578c2977 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:05.900321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0b85e-a737-42e9-8514-5cb392fd99ab None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.900641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0b85e-a737-42e9-8514-5cb392fd99ab None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.900918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0b85e-a737-42e9-8514-5cb392fd99ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.913159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1141/2275] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:43:05.914085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4826b-c742-4ded-9ed2-cba5554e88e7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.920351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c8a0b85e-a737-42e9-8514-5cb392fd99ab None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:05.921590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c8a0b85e-a737-42e9-8514-5cb392fd99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:05.924609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4826b-c742-4ded-9ed2-cba5554e88e7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:05.980899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce253-1b78-4d64-95e6-ec4f15cb2f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:05.981517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce253-1b78-4d64-95e6-ec4f15cb2f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:05.981779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce253-1b78-4d64-95e6-ec4f15cb2f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:05.982017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1135/2276] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:05.982128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce253-1b78-4d64-95e6-ec4f15cb2f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:05.985155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ce253-1b78-4d64-95e6-ec4f15cb2f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:05.987053 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ce253-1b78-4d64-95e6-ec4f15cb2f9e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:05.991917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0b85e-a737-42e9-8514-5cb392fd99ab None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:05.993293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c8a0b85e-a737-42e9-8514-5cb392fd99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:06.016607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1142/2277] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:05 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:06.019682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce253-1b78-4d64-95e6-ec4f15cb2f9e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.060704 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0b85e-a737-42e9-8514-5cb392fd99ab None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.083914 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce253-1b78-4d64-95e6-ec4f15cb2f9e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.088930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cb932-2713-4397-b8cf-c76aaac4eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.089544 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cb932-2713-4397-b8cf-c76aaac4eb3d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.089828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cb932-2713-4397-b8cf-c76aaac4eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.090102 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cb932-2713-4397-b8cf-c76aaac4eb3d admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.090730 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cb932-2713-4397-b8cf-c76aaac4eb3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.092672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cb932-2713-4397-b8cf-c76aaac4eb3d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.101990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:06.113865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631b1cc-d804-4b13-82b3-35290e441c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.114481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631b1cc-d804-4b13-82b3-35290e441c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.114768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631b1cc-d804-4b13-82b3-35290e441c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.115045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631b1cc-d804-4b13-82b3-35290e441c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.117829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1143/2278] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:06 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:06.124436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cb932-2713-4397-b8cf-c76aaac4eb3d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.126199 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631b1cc-d804-4b13-82b3-35290e441c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.127946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631b1cc-d804-4b13-82b3-35290e441c4a service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.134856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cb932-2713-4397-b8cf-c76aaac4eb3d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.138342 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1136/2279] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:43:06.140273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5acf2-ecf7-4762-8e1b-8bfce2cb4a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.140925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5acf2-ecf7-4762-8e1b-8bfce2cb4a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.141202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5acf2-ecf7-4762-8e1b-8bfce2cb4a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.141479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5acf2-ecf7-4762-8e1b-8bfce2cb4a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.142126 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5acf2-ecf7-4762-8e1b-8bfce2cb4a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.144420 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5acf2-ecf7-4762-8e1b-8bfce2cb4a00 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.154922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1144/2280] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:06.159051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631b1cc-d804-4b13-82b3-35290e441c4a service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.170109 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631b1cc-d804-4b13-82b3-35290e441c4a service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.178056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ed298-c6c9-42ed-84a9-b5f7d9d459f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.178671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ed298-c6c9-42ed-84a9-b5f7d9d459f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.178956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ed298-c6c9-42ed-84a9-b5f7d9d459f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.179233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ed298-c6c9-42ed-84a9-b5f7d9d459f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.179879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ed298-c6c9-42ed-84a9-b5f7d9d459f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.182233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ed298-c6c9-42ed-84a9-b5f7d9d459f5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.192924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1137/2281] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:06.197181 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5acf2-ecf7-4762-8e1b-8bfce2cb4a00 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.208987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5acf2-ecf7-4762-8e1b-8bfce2cb4a00 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.217189 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c609795-a2cb-482b-bdc9-de4d0fed1420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.217870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c609795-a2cb-482b-bdc9-de4d0fed1420 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.218350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c609795-a2cb-482b-bdc9-de4d0fed1420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.218646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c609795-a2cb-482b-bdc9-de4d0fed1420 admin admin] PATH_INFO: `/v3/projects/120936c1b1924a2ebbc7e2f4fdaf3a21/users/0efcc57b481c49188b06c90bae0c5773/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.239237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c609795-a2cb-482b-bdc9-de4d0fed1420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120936c1b1924a2ebbc7e2f4fdaf3a21, user_id=0efcc57b481c49188b06c90bae0c5773, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.240954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c609795-a2cb-482b-bdc9-de4d0fed1420 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.261003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1145/2282] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:06 2022] PUT /identity/v3/projects/120936c1b1924a2ebbc7e2f4fdaf3a21/users/0efcc57b481c49188b06c90bae0c5773/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:06.271925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed6581-c2f8-4def-acab-e901dba0791e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.272303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed6581-c2f8-4def-acab-e901dba0791e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.272709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed6581-c2f8-4def-acab-e901dba0791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.302157 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-92ed6581-c2f8-4def-acab-e901dba0791e None None] MFA Rules not processed for user `0efcc57b481c49188b06c90bae0c5773`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:06.303377 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-92ed6581-c2f8-4def-acab-e901dba0791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:06.315883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:06.377614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1138/2283] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:06.382361 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c609795-a2cb-482b-bdc9-de4d0fed1420 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.445864 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed6581-c2f8-4def-acab-e901dba0791e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.448009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-92ed6581-c2f8-4def-acab-e901dba0791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:06.452060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c609795-a2cb-482b-bdc9-de4d0fed1420 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.457578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b6490-57e9-462f-944f-c31d83be8887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.458195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b6490-57e9-462f-944f-c31d83be8887 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.459023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b6490-57e9-462f-944f-c31d83be8887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.459297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b6490-57e9-462f-944f-c31d83be8887 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.460158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b6490-57e9-462f-944f-c31d83be8887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.462360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed6581-c2f8-4def-acab-e901dba0791e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.463120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b6490-57e9-462f-944f-c31d83be8887 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.467262 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.467897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.468176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.468450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] PATH_INFO: `/v3/projects/beb10610ba4346b2ab4373afeb7e185e` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.469612 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb10610ba4346b2ab4373afeb7e185e)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.471575 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.493042 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1146/2284] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:06 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:06.497792 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b6490-57e9-462f-944f-c31d83be8887 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.522743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb10610ba4346b2ab4373afeb7e185e', 'request_id': 'req-d405f183-fb29-4e31-89b0-a256d8de2f55'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:06.531257 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb10610ba4346b2ab4373afeb7e185e', 'request_id': 'req-d405f183-fb29-4e31-89b0-a256d8de2f55'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:06.537133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb10610ba4346b2ab4373afeb7e185e', 'request_id': 'req-d405f183-fb29-4e31-89b0-a256d8de2f55'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:06.548855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] The token cache is being invalidate because project beb10610ba4346b2ab4373afeb7e185e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:06.549144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:06.549815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d405f183-fb29-4e31-89b0-a256d8de2f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:06.551324 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1139/2285] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:06 2022] DELETE /identity/v3/projects/beb10610ba4346b2ab4373afeb7e185e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:06.555883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510572ca-8cb9-489c-979a-fe295a4ef6de None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.556167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510572ca-8cb9-489c-979a-fe295a4ef6de None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.557007 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510572ca-8cb9-489c-979a-fe295a4ef6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.565239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b6490-57e9-462f-944f-c31d83be8887 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.577248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-510572ca-8cb9-489c-979a-fe295a4ef6de None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:06.578453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-510572ca-8cb9-489c-979a-fe295a4ef6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:06.610427 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:06.624124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446a102-2d57-4859-9ce0-eccb655ed142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.624782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a102-2d57-4859-9ce0-eccb655ed142 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.625067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a102-2d57-4859-9ce0-eccb655ed142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.625621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a102-2d57-4859-9ce0-eccb655ed142 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.625953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446a102-2d57-4859-9ce0-eccb655ed142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.627858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446a102-2d57-4859-9ce0-eccb655ed142 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.639962 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1140/2286] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:06.648144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5afdff-fb1e-46dc-b2c7-ea998cbaa798 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.648419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5afdff-fb1e-46dc-b2c7-ea998cbaa798 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.648725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5afdff-fb1e-46dc-b2c7-ea998cbaa798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.648850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1147/2287] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:06 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:06.652771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446a102-2d57-4859-9ce0-eccb655ed142 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.654433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6446a102-2d57-4859-9ce0-eccb655ed142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:06.666679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446a102-2d57-4859-9ce0-eccb655ed142 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.671261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c33c86-a34d-484f-bb7e-fda17660c570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.671487 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0a5afdff-fb1e-46dc-b2c7-ea998cbaa798 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:06.671843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c33c86-a34d-484f-bb7e-fda17660c570 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.672122 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c33c86-a34d-484f-bb7e-fda17660c570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.672389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c33c86-a34d-484f-bb7e-fda17660c570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.672693 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0a5afdff-fb1e-46dc-b2c7-ea998cbaa798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:06.673062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c33c86-a34d-484f-bb7e-fda17660c570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.674635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c33c86-a34d-484f-bb7e-fda17660c570 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.680783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1141/2288] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:06.688343 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1148/2289] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:06.688707 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5afdff-fb1e-46dc-b2c7-ea998cbaa798 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.689433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c33c86-a34d-484f-bb7e-fda17660c570 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.694729 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5afdff-fb1e-46dc-b2c7-ea998cbaa798 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.699130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c33c86-a34d-484f-bb7e-fda17660c570 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.700202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a704734-b88d-4133-ac7a-1751db4b902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.700907 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a704734-b88d-4133-ac7a-1751db4b902f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.701186 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a704734-b88d-4133-ac7a-1751db4b902f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.701598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a704734-b88d-4133-ac7a-1751db4b902f admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.702276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a704734-b88d-4133-ac7a-1751db4b902f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:06.702582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a704734-b88d-4133-ac7a-1751db4b902f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.703794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fed38-8bd7-41af-b7f7-8ab2e20a62ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.704282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a704734-b88d-4133-ac7a-1751db4b902f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.704417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fed38-8bd7-41af-b7f7-8ab2e20a62ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.704731 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fed38-8bd7-41af-b7f7-8ab2e20a62ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.705005 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fed38-8bd7-41af-b7f7-8ab2e20a62ca admin admin] PATH_INFO: `/v3/projects/8b862f5a6c624ba5b345a883d00113ff/users/c8f303d419b84aa9b7949dc8d74c8174/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.716120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1142/2290] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:43:06.720422 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a704734-b88d-4133-ac7a-1751db4b902f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.723987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fed38-8bd7-41af-b7f7-8ab2e20a62ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b862f5a6c624ba5b345a883d00113ff, user_id=c8f303d419b84aa9b7949dc8d74c8174, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.726889 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fed38-8bd7-41af-b7f7-8ab2e20a62ca admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.730732 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a704734-b88d-4133-ac7a-1751db4b902f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.735819 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a50937-697d-4429-8b7b-37952c0a0478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.736404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50937-697d-4429-8b7b-37952c0a0478 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.736705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50937-697d-4429-8b7b-37952c0a0478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.736982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50937-697d-4429-8b7b-37952c0a0478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.737599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a50937-697d-4429-8b7b-37952c0a0478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.739466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a50937-697d-4429-8b7b-37952c0a0478 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.741353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1149/2291] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:06 2022] PUT /identity/v3/projects/8b862f5a6c624ba5b345a883d00113ff/users/c8f303d419b84aa9b7949dc8d74c8174/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:06.746184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fed38-8bd7-41af-b7f7-8ab2e20a62ca admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.755626 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:06.770213 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1143/2292] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:06 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:06.774742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a50937-697d-4429-8b7b-37952c0a0478 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.811522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fed38-8bd7-41af-b7f7-8ab2e20a62ca admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.839583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a50937-697d-4429-8b7b-37952c0a0478 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.845754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811bff9-658e-4623-a543-2631318f814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.846362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811bff9-658e-4623-a543-2631318f814f admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.846645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811bff9-658e-4623-a543-2631318f814f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.846920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811bff9-658e-4623-a543-2631318f814f admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.847583 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811bff9-658e-4623-a543-2631318f814f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.849540 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811bff9-658e-4623-a543-2631318f814f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.868381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244afbee-2a5e-4002-a25e-772ce4f99ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.869813 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afbee-2a5e-4002-a25e-772ce4f99ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.870137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afbee-2a5e-4002-a25e-772ce4f99ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.870407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afbee-2a5e-4002-a25e-772ce4f99ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.871067 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244afbee-2a5e-4002-a25e-772ce4f99ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.872656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244afbee-2a5e-4002-a25e-772ce4f99ccf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.874112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1144/2293] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:06 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:06.877880 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811bff9-658e-4623-a543-2631318f814f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.883132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1150/2294] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:06.886943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244afbee-2a5e-4002-a25e-772ce4f99ccf admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.891303 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811bff9-658e-4623-a543-2631318f814f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.896105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4223410-c0a2-4090-848a-f6532faffba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.896738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4223410-c0a2-4090-848a-f6532faffba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.896947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244afbee-2a5e-4002-a25e-772ce4f99ccf admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.897070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4223410-c0a2-4090-848a-f6532faffba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.897283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4223410-c0a2-4090-848a-f6532faffba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.897928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4223410-c0a2-4090-848a-f6532faffba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.899525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4223410-c0a2-4090-848a-f6532faffba8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.902148 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e1247-4061-4da9-b83a-5fd74d0a0beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.902773 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1247-4061-4da9-b83a-5fd74d0a0beb admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.903054 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1247-4061-4da9-b83a-5fd74d0a0beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.903328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1247-4061-4da9-b83a-5fd74d0a0beb admin admin] PATH_INFO: `/v3/projects/8b862f5a6c624ba5b345a883d00113ff/users/c8f303d419b84aa9b7949dc8d74c8174/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.905623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e1247-4061-4da9-b83a-5fd74d0a0beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b862f5a6c624ba5b345a883d00113ff, user_id=c8f303d419b84aa9b7949dc8d74c8174, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.909799 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e1247-4061-4da9-b83a-5fd74d0a0beb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.910058 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1145/2295] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:06.914144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4223410-c0a2-4090-848a-f6532faffba8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:06.921858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1151/2296] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:06 2022] PUT /identity/v3/projects/8b862f5a6c624ba5b345a883d00113ff/users/c8f303d419b84aa9b7949dc8d74c8174/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:06.926672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4223410-c0a2-4090-848a-f6532faffba8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:06.932619 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade0a5b-216b-4de2-a1f3-cca08e49f33e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.932966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade0a5b-216b-4de2-a1f3-cca08e49f33e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.933230 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade0a5b-216b-4de2-a1f3-cca08e49f33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.967281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dade0a5b-216b-4de2-a1f3-cca08e49f33e None None] MFA Rules not processed for user `c8f303d419b84aa9b7949dc8d74c8174`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:06.968531 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dade0a5b-216b-4de2-a1f3-cca08e49f33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:06.986102 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a542e79-3af5-47fc-8f1b-81b8a0e2784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:06.986725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a542e79-3af5-47fc-8f1b-81b8a0e2784b admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:06.987009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a542e79-3af5-47fc-8f1b-81b8a0e2784b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:06.987284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a542e79-3af5-47fc-8f1b-81b8a0e2784b admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:06.988064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a542e79-3af5-47fc-8f1b-81b8a0e2784b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:06.989708 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a542e79-3af5-47fc-8f1b-81b8a0e2784b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:06.990840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:07.000428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1146/2297] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:07.004684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a542e79-3af5-47fc-8f1b-81b8a0e2784b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:07.014416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a542e79-3af5-47fc-8f1b-81b8a0e2784b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:07.019413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85371695-11b7-45c7-8a4c-f68cffa72b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:07.020057 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85371695-11b7-45c7-8a4c-f68cffa72b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:07.020348 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85371695-11b7-45c7-8a4c-f68cffa72b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:07.020651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85371695-11b7-45c7-8a4c-f68cffa72b99 admin admin] PATH_INFO: `/v3/projects/c719187968ba4756a6bc20304375c277/users/a60c332e77bb49f688a2188dbe54c81c/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:07.036985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85371695-11b7-45c7-8a4c-f68cffa72b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c719187968ba4756a6bc20304375c277, user_id=a60c332e77bb49f688a2188dbe54c81c, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:07.039599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85371695-11b7-45c7-8a4c-f68cffa72b99 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:07.048780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1152/2298] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:07.054965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1147/2299] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:07 2022] PUT /identity/v3/projects/c719187968ba4756a6bc20304375c277/users/a60c332e77bb49f688a2188dbe54c81c/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:07.060128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade0a5b-216b-4de2-a1f3-cca08e49f33e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:07.061790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dade0a5b-216b-4de2-a1f3-cca08e49f33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:07.065577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47198786-2193-4f5e-8d1f-4d9fd57db228 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:07.065866 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47198786-2193-4f5e-8d1f-4d9fd57db228 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:07.066165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47198786-2193-4f5e-8d1f-4d9fd57db228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:07.101709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-47198786-2193-4f5e-8d1f-4d9fd57db228 None None] MFA Rules not processed for user `a60c332e77bb49f688a2188dbe54c81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:07.102915 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-47198786-2193-4f5e-8d1f-4d9fd57db228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:07.121514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade0a5b-216b-4de2-a1f3-cca08e49f33e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:07.142990 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:07.174080 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ec245-247b-4dc8-a78d-4754e05f975c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:07.174814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ec245-247b-4dc8-a78d-4754e05f975c service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:07.175100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ec245-247b-4dc8-a78d-4754e05f975c service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:07.175378 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ec245-247b-4dc8-a78d-4754e05f975c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:07.180565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1148/2300] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:07.195281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47198786-2193-4f5e-8d1f-4d9fd57db228 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:07.197479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-47198786-2193-4f5e-8d1f-4d9fd57db228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:07.248850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ec245-247b-4dc8-a78d-4754e05f975c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:07.250355 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ec245-247b-4dc8-a78d-4754e05f975c service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:07.261413 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1153/2301] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:07.262227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47198786-2193-4f5e-8d1f-4d9fd57db228 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:07.266464 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb948e3-72fc-4d70-8acd-e306c2c3742b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b71b778b0b24cbb92446070934d68ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:07.267173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb948e3-72fc-4d70-8acd-e306c2c3742b service glance] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:07.267521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb948e3-72fc-4d70-8acd-e306c2c3742b service glance] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:07.267865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb948e3-72fc-4d70-8acd-e306c2c3742b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:07.278479 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb948e3-72fc-4d70-8acd-e306c2c3742b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:07.279915 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb948e3-72fc-4d70-8acd-e306c2c3742b service glance] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:07.289360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1149/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:07.345899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ec245-247b-4dc8-a78d-4754e05f975c service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:07.347432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c36ec245-247b-4dc8-a78d-4754e05f975c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:07.360226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ec245-247b-4dc8-a78d-4754e05f975c service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:07.366789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30cff-98f9-4246-9fbf-b093b72612e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:07.367542 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30cff-98f9-4246-9fbf-b093b72612e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:07.367836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30cff-98f9-4246-9fbf-b093b72612e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:07.368117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30cff-98f9-4246-9fbf-b093b72612e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:07.369959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-86f30cff-98f9-4246-9fbf-b093b72612e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:07.394055 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:07.434930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30cff-98f9-4246-9fbf-b093b72612e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:07.436430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30cff-98f9-4246-9fbf-b093b72612e0 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:07.445371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1154/2303] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:10.189056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb948e3-72fc-4d70-8acd-e306c2c3742b service glance] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:10.259791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb948e3-72fc-4d70-8acd-e306c2c3742b service glance] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:10.263954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:10.264620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:10.264899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:10.265175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] PATH_INFO: `/v3/users/0efcc57b481c49188b06c90bae0c5773` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:10.266287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0efcc57b481c49188b06c90bae0c5773)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:10.268230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:10.314796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0efcc57b481c49188b06c90bae0c5773'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:10.315366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0efcc57b481c49188b06c90bae0c5773'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:10.322391 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0efcc57b481c49188b06c90bae0c5773'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:10.322976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0efcc57b481c49188b06c90bae0c5773'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:10.335585 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0efcc57b481c49188b06c90bae0c5773'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:10.339689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:10.350621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1150/2304] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:10 2022] DELETE /identity/v3/users/0efcc57b481c49188b06c90bae0c5773 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:10.356031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd3d10-b48f-49e9-8564-a49d207d51c8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:10.356549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd3d10-b48f-49e9-8564-a49d207d51c8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:10.356832 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd3d10-b48f-49e9-8564-a49d207d51c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:10.376657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1ffd3d10-b48f-49e9-8564-a49d207d51c8 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:10.377851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1ffd3d10-b48f-49e9-8564-a49d207d51c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:10.435358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1155/2305] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:10.445293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:10.446668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:10.518872 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18c489-c616-46af-a0b4-08c32c3a3409 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:10.522536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf402b-c422-4adb-b414-8b52279016eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:10.523139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf402b-c422-4adb-b414-8b52279016eb service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:10.523416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf402b-c422-4adb-b414-8b52279016eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:10.523688 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf402b-c422-4adb-b414-8b52279016eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:10.534534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf402b-c422-4adb-b414-8b52279016eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:10.535968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf402b-c422-4adb-b414-8b52279016eb service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:10.545966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1151/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:10.813006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd3d10-b48f-49e9-8564-a49d207d51c8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:10.814489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1ffd3d10-b48f-49e9-8564-a49d207d51c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:10.830132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd3d10-b48f-49e9-8564-a49d207d51c8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:10.835001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:10.835639 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:10.835954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:10.836209 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] PATH_INFO: `/v3/projects/120936c1b1924a2ebbc7e2f4fdaf3a21` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:10.838204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120936c1b1924a2ebbc7e2f4fdaf3a21)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:10.840379 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:10.890941 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120936c1b1924a2ebbc7e2f4fdaf3a21', 'request_id': 'req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:10.896779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120936c1b1924a2ebbc7e2f4fdaf3a21', 'request_id': 'req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:10.904126 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120936c1b1924a2ebbc7e2f4fdaf3a21', 'request_id': 'req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:10.917734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] The token cache is being invalidate because project 120936c1b1924a2ebbc7e2f4fdaf3a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:10.918025 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:10.918640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:10.920285 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1156/2307] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:10 2022] DELETE /identity/v3/projects/120936c1b1924a2ebbc7e2f4fdaf3a21 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:10.924487 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf402b-c422-4adb-b414-8b52279016eb service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:10.934647 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf402b-c422-4adb-b414-8b52279016eb service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:10.995704 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:10.996645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:10.997003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:10.997276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] PATH_INFO: `/v3/users/c8f303d419b84aa9b7949dc8d74c8174` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:10.998478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f303d419b84aa9b7949dc8d74c8174)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:11.000453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:11.051624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f303d419b84aa9b7949dc8d74c8174'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:11.052277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f303d419b84aa9b7949dc8d74c8174'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:11.059468 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f303d419b84aa9b7949dc8d74c8174'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:11.060102 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f303d419b84aa9b7949dc8d74c8174'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:11.073204 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-c0322117-dd28-4b40-8b0c-7a38836f581d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f303d419b84aa9b7949dc8d74c8174'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:11.087289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1152/2308] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:10 2022] DELETE /identity/v3/users/c8f303d419b84aa9b7949dc8d74c8174 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:11.365499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:11.366949 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:11.381596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a733d2a-f8f6-40ae-8aa7-a1bc78d9b556 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:11.429693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:11.443497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:11.444073 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:11.444353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:11.444674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] PATH_INFO: `/v3/projects/8b862f5a6c624ba5b345a883d00113ff` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:11.445790 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b862f5a6c624ba5b345a883d00113ff)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:11.448227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:11.505667 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b862f5a6c624ba5b345a883d00113ff', 'request_id': 'req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:11.511920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b862f5a6c624ba5b345a883d00113ff', 'request_id': 'req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:11.518270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b862f5a6c624ba5b345a883d00113ff', 'request_id': 'req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:11.531190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] The token cache is being invalidate because project 8b862f5a6c624ba5b345a883d00113ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:11.531480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:11.532090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e68eda9a-1fb0-45da-bfd1-bf76b2653a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:11.533580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1157/2309] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:11 2022] DELETE /identity/v3/projects/8b862f5a6c624ba5b345a883d00113ff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:11.538461 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec173b-ad97-4ed7-b341-e2648fdeecff None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:11.538929 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec173b-ad97-4ed7-b341-e2648fdeecff None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:11.539044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec173b-ad97-4ed7-b341-e2648fdeecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:11.558427 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7cec173b-ad97-4ed7-b341-e2648fdeecff None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:11.559609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7cec173b-ad97-4ed7-b341-e2648fdeecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:11.571231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:11.621173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1153/2310] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:11.633872 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35357b9-2d2f-4505-80d1-334497dd91ee None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:11.634159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35357b9-2d2f-4505-80d1-334497dd91ee None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:11.635028 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35357b9-2d2f-4505-80d1-334497dd91ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:11.654628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f35357b9-2d2f-4505-80d1-334497dd91ee None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:11.655833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f35357b9-2d2f-4505-80d1-334497dd91ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:11.663663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1158/2311] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:11.668238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec173b-ad97-4ed7-b341-e2648fdeecff None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:11.677898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec173b-ad97-4ed7-b341-e2648fdeecff None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:11.683187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d27e7a-7e22-44e8-b5be-20a9e026e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:11.683781 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27e7a-7e22-44e8-b5be-20a9e026e548 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:11.684063 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27e7a-7e22-44e8-b5be-20a9e026e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:11.684338 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27e7a-7e22-44e8-b5be-20a9e026e548 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:11.685025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d27e7a-7e22-44e8-b5be-20a9e026e548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:11.685327 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d27e7a-7e22-44e8-b5be-20a9e026e548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:11.686917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d27e7a-7e22-44e8-b5be-20a9e026e548 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:11.698885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1154/2312] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:43:11.702912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35357b9-2d2f-4505-80d1-334497dd91ee None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:11.712904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35357b9-2d2f-4505-80d1-334497dd91ee None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:11.718273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc8f19-915e-4e2d-851b-82c22a7a5ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:11.718992 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8f19-915e-4e2d-851b-82c22a7a5ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:11.719283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8f19-915e-4e2d-851b-82c22a7a5ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:11.719551 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc8f19-915e-4e2d-851b-82c22a7a5ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:11.720180 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc8f19-915e-4e2d-851b-82c22a7a5ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:11.722462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc8f19-915e-4e2d-851b-82c22a7a5ff8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:11.757392 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1159/2313] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:11 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:11.762127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d27e7a-7e22-44e8-b5be-20a9e026e548 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:11.772099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d27e7a-7e22-44e8-b5be-20a9e026e548 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:11.827334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14302b65-4ed9-44f8-8220-2cfd2d14c4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:11.827945 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14302b65-4ed9-44f8-8220-2cfd2d14c4ad admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:11.828223 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14302b65-4ed9-44f8-8220-2cfd2d14c4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:11.828521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14302b65-4ed9-44f8-8220-2cfd2d14c4ad admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:11.829154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14302b65-4ed9-44f8-8220-2cfd2d14c4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:11.831066 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14302b65-4ed9-44f8-8220-2cfd2d14c4ad admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:11.851919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1155/2314] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:11 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:11.856081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc8f19-915e-4e2d-851b-82c22a7a5ff8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:11.866479 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc8f19-915e-4e2d-851b-82c22a7a5ff8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:11.871738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15698919-4221-441a-bef1-5e4a0f023b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:11.872324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15698919-4221-441a-bef1-5e4a0f023b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:11.872646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15698919-4221-441a-bef1-5e4a0f023b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:11.872920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15698919-4221-441a-bef1-5e4a0f023b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:11.873555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15698919-4221-441a-bef1-5e4a0f023b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:11.875127 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15698919-4221-441a-bef1-5e4a0f023b84 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:11.885571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1160/2315] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:11.889497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14302b65-4ed9-44f8-8220-2cfd2d14c4ad admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:11.899268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14302b65-4ed9-44f8-8220-2cfd2d14c4ad admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:11.904149 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db4644-7b9c-497c-9a9a-99edeb725c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:11.904769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4644-7b9c-497c-9a9a-99edeb725c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:11.905051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4644-7b9c-497c-9a9a-99edeb725c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:11.905325 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4644-7b9c-497c-9a9a-99edeb725c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:11.905960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db4644-7b9c-497c-9a9a-99edeb725c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:11.907543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db4644-7b9c-497c-9a9a-99edeb725c17 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:11.917855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1156/2316] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:11.922463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15698919-4221-441a-bef1-5e4a0f023b84 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:11.938281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15698919-4221-441a-bef1-5e4a0f023b84 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:11.942983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7af9b-9928-4a4c-bce0-4079f9df846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:11.943630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7af9b-9928-4a4c-bce0-4079f9df846f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:11.943908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7af9b-9928-4a4c-bce0-4079f9df846f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:11.944177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7af9b-9928-4a4c-bce0-4079f9df846f admin admin] PATH_INFO: `/v3/projects/4b652a1280804d03a1c3b1725ef70890/users/aa173355b0b34d00b9209ddf3dbc4ab5/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:11.960198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7af9b-9928-4a4c-bce0-4079f9df846f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b652a1280804d03a1c3b1725ef70890, user_id=aa173355b0b34d00b9209ddf3dbc4ab5, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:11.963914 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7af9b-9928-4a4c-bce0-4079f9df846f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:11.982842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1161/2317] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:11 2022] PUT /identity/v3/projects/4b652a1280804d03a1c3b1725ef70890/users/aa173355b0b34d00b9209ddf3dbc4ab5/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:11.995025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442baba4-a09f-45af-8dfe-b118fc8ee3fa None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:11.995300 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442baba4-a09f-45af-8dfe-b118fc8ee3fa None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:11.995571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442baba4-a09f-45af-8dfe-b118fc8ee3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:12.023965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-442baba4-a09f-45af-8dfe-b118fc8ee3fa None None] MFA Rules not processed for user `aa173355b0b34d00b9209ddf3dbc4ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:12.025185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-442baba4-a09f-45af-8dfe-b118fc8ee3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:12.090587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1157/2318] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:12.095232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7af9b-9928-4a4c-bce0-4079f9df846f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:12.156758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7af9b-9928-4a4c-bce0-4079f9df846f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:12.161334 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9e21f-00bc-4e90-b568-130ffdea0bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:12.161926 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9e21f-00bc-4e90-b568-130ffdea0bff admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:12.162204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9e21f-00bc-4e90-b568-130ffdea0bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:12.162470 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9e21f-00bc-4e90-b568-130ffdea0bff admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:12.163081 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9e21f-00bc-4e90-b568-130ffdea0bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:12.164987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9e21f-00bc-4e90-b568-130ffdea0bff admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:12.185613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:12.194484 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1162/2319] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:12 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:12.198773 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442baba4-a09f-45af-8dfe-b118fc8ee3fa None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:12.210085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442baba4-a09f-45af-8dfe-b118fc8ee3fa None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:12.219712 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:12.272101 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b864aff-2b85-49ae-8036-50ede29f9c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:12.272738 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b864aff-2b85-49ae-8036-50ede29f9c18 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:12.273035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b864aff-2b85-49ae-8036-50ede29f9c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:12.273298 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b864aff-2b85-49ae-8036-50ede29f9c18 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:12.273921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b864aff-2b85-49ae-8036-50ede29f9c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:12.276446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b864aff-2b85-49ae-8036-50ede29f9c18 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:12.297219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1158/2320] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:12 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:12.301215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9e21f-00bc-4e90-b568-130ffdea0bff admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:12.312150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9e21f-00bc-4e90-b568-130ffdea0bff admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:12.316978 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad60818-c655-4d1d-ab8c-2bb3c787ee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:12.317590 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad60818-c655-4d1d-ab8c-2bb3c787ee55 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:12.317875 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad60818-c655-4d1d-ab8c-2bb3c787ee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:12.318146 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad60818-c655-4d1d-ab8c-2bb3c787ee55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:12.318787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad60818-c655-4d1d-ab8c-2bb3c787ee55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:12.320380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad60818-c655-4d1d-ab8c-2bb3c787ee55 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:12.331957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1163/2321] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:12.336070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b864aff-2b85-49ae-8036-50ede29f9c18 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:12.347203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b864aff-2b85-49ae-8036-50ede29f9c18 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:12.351783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a1f82-17a0-4e10-ba11-7c507a6e68b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:12.352429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a1f82-17a0-4e10-ba11-7c507a6e68b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:12.352750 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a1f82-17a0-4e10-ba11-7c507a6e68b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:12.354019 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a1f82-17a0-4e10-ba11-7c507a6e68b1 admin admin] PATH_INFO: `/v3/projects/45095ca5cc9c433489906a7642ec791e/users/d6d67e47bc5e426488e35c433aaaf7a5/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:12.369630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a1f82-17a0-4e10-ba11-7c507a6e68b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45095ca5cc9c433489906a7642ec791e, user_id=d6d67e47bc5e426488e35c433aaaf7a5, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:12.372335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a1f82-17a0-4e10-ba11-7c507a6e68b1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:12.385697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1159/2322] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:12 2022] PUT /identity/v3/projects/45095ca5cc9c433489906a7642ec791e/users/d6d67e47bc5e426488e35c433aaaf7a5/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:12.389738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad60818-c655-4d1d-ab8c-2bb3c787ee55 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:12.399754 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad60818-c655-4d1d-ab8c-2bb3c787ee55 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:12.459724 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b4dc2-be4c-416f-b6c6-0c06a32b72a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:12.460626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b4dc2-be4c-416f-b6c6-0c06a32b72a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:12.460828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b4dc2-be4c-416f-b6c6-0c06a32b72a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:12.461105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b4dc2-be4c-416f-b6c6-0c06a32b72a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:12.461909 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b4dc2-be4c-416f-b6c6-0c06a32b72a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:12.464534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b4dc2-be4c-416f-b6c6-0c06a32b72a3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:12.476615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1164/2323] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:12.481622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a1f82-17a0-4e10-ba11-7c507a6e68b1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:12.494207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a1f82-17a0-4e10-ba11-7c507a6e68b1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:12.498913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef2895-6fe8-4041-80eb-5ea4814db74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:12.499564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef2895-6fe8-4041-80eb-5ea4814db74b admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:12.499846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef2895-6fe8-4041-80eb-5ea4814db74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:12.500116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef2895-6fe8-4041-80eb-5ea4814db74b admin admin] PATH_INFO: `/v3/projects/45095ca5cc9c433489906a7642ec791e/users/d6d67e47bc5e426488e35c433aaaf7a5/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:12.502043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef2895-6fe8-4041-80eb-5ea4814db74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45095ca5cc9c433489906a7642ec791e, user_id=d6d67e47bc5e426488e35c433aaaf7a5, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:12.504718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef2895-6fe8-4041-80eb-5ea4814db74b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:12.515071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1160/2324] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:12 2022] PUT /identity/v3/projects/45095ca5cc9c433489906a7642ec791e/users/d6d67e47bc5e426488e35c433aaaf7a5/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:12.526499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01627daa-f16a-43cd-8daa-5a4d63956b12 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:12.526866 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01627daa-f16a-43cd-8daa-5a4d63956b12 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:12.527228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01627daa-f16a-43cd-8daa-5a4d63956b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:12.555295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-01627daa-f16a-43cd-8daa-5a4d63956b12 None None] MFA Rules not processed for user `d6d67e47bc5e426488e35c433aaaf7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:12.556565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-01627daa-f16a-43cd-8daa-5a4d63956b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:12.623868 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1165/2325] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:12.635571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef2895-6fe8-4041-80eb-5ea4814db74b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:12.637412 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f0ef2895-6fe8-4041-80eb-5ea4814db74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:12.696390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef2895-6fe8-4041-80eb-5ea4814db74b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:12.700636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29f97-3469-4476-b7cb-bd09bcfe0058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:12.701241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29f97-3469-4476-b7cb-bd09bcfe0058 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:12.701520 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29f97-3469-4476-b7cb-bd09bcfe0058 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:12.701789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29f97-3469-4476-b7cb-bd09bcfe0058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:12.711081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c29f97-3469-4476-b7cb-bd09bcfe0058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:12.713113 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c29f97-3469-4476-b7cb-bd09bcfe0058 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:12.722786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1161/2326] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:12.771947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01627daa-f16a-43cd-8daa-5a4d63956b12 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:12.773383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-01627daa-f16a-43cd-8daa-5a4d63956b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:12.785677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01627daa-f16a-43cd-8daa-5a4d63956b12 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:12.789357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84097f3-a886-4e4f-9a42-695677895e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:12.789954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84097f3-a886-4e4f-9a42-695677895e45 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:12.790250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84097f3-a886-4e4f-9a42-695677895e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:12.791062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84097f3-a886-4e4f-9a42-695677895e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:12.847207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84097f3-a886-4e4f-9a42-695677895e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:12.848583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84097f3-a886-4e4f-9a42-695677895e45 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:12.857777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1166/2327] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:16.193696 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29f97-3469-4476-b7cb-bd09bcfe0058 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:16.273574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29f97-3469-4476-b7cb-bd09bcfe0058 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:16.278253 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:16.278895 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:16.279179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:16.279453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] PATH_INFO: `/v3/users/aa173355b0b34d00b9209ddf3dbc4ab5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:16.280597 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa173355b0b34d00b9209ddf3dbc4ab5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:16.282512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:16.292697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:16.328277 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa173355b0b34d00b9209ddf3dbc4ab5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:16.328944 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa173355b0b34d00b9209ddf3dbc4ab5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:16.336506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa173355b0b34d00b9209ddf3dbc4ab5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:16.337080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa173355b0b34d00b9209ddf3dbc4ab5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:16.348737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa173355b0b34d00b9209ddf3dbc4ab5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:16.361779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1162/2328] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:16 2022] DELETE /identity/v3/users/aa173355b0b34d00b9209ddf3dbc4ab5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:16.366397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa850423-3de4-467f-b746-6d4368127ea0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:16.366872 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa850423-3de4-467f-b746-6d4368127ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:16.366968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa850423-3de4-467f-b746-6d4368127ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:16.380536 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:16.386885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aa850423-3de4-467f-b746-6d4368127ea0 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:16.388477 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa850423-3de4-467f-b746-6d4368127ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:16.446476 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1167/2329] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:16.456933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:16.458828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:16.523351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c0ba9-36ad-4cf4-b5f8-01c842e55a8a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:16.527060 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36588d-8e5c-497c-8baa-c2b744be9095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:16.527666 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36588d-8e5c-497c-8baa-c2b744be9095 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:16.528065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36588d-8e5c-497c-8baa-c2b744be9095 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:16.528545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36588d-8e5c-497c-8baa-c2b744be9095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:16.537434 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36588d-8e5c-497c-8baa-c2b744be9095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:16.538845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36588d-8e5c-497c-8baa-c2b744be9095 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:16.548606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1163/2330] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:16.827221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa850423-3de4-467f-b746-6d4368127ea0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:16.828913 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa850423-3de4-467f-b746-6d4368127ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:16.848205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa850423-3de4-467f-b746-6d4368127ea0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:16.853079 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:16.853719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:16.853999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:16.854273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] PATH_INFO: `/v3/projects/4b652a1280804d03a1c3b1725ef70890` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:16.855404 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b652a1280804d03a1c3b1725ef70890)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:16.857983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:16.904173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b652a1280804d03a1c3b1725ef70890', 'request_id': 'req-967707b5-cd19-4789-93ad-e5a90955c3e0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:16.909550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b652a1280804d03a1c3b1725ef70890', 'request_id': 'req-967707b5-cd19-4789-93ad-e5a90955c3e0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:16.915595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b652a1280804d03a1c3b1725ef70890', 'request_id': 'req-967707b5-cd19-4789-93ad-e5a90955c3e0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:16.928183 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] The token cache is being invalidate because project 4b652a1280804d03a1c3b1725ef70890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:16.928478 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:16.929102 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:16.930594 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1168/2331] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:16 2022] DELETE /identity/v3/projects/4b652a1280804d03a1c3b1725ef70890 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:16.934873 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36588d-8e5c-497c-8baa-c2b744be9095 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:16.945067 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36588d-8e5c-497c-8baa-c2b744be9095 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:17.005789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:17.006419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.006697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.006971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] PATH_INFO: `/v3/users/d6d67e47bc5e426488e35c433aaaf7a5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:17.008080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d67e47bc5e426488e35c433aaaf7a5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:17.010046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:17.045035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:17.059205 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d67e47bc5e426488e35c433aaaf7a5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:17.059835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d67e47bc5e426488e35c433aaaf7a5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:17.066621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d67e47bc5e426488e35c433aaaf7a5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:17.067233 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d67e47bc5e426488e35c433aaaf7a5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:17.079721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-68ad0355-cf15-4cca-bf31-d5a2a3a08dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d67e47bc5e426488e35c433aaaf7a5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:17.092435 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1164/2332] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:16 2022] DELETE /identity/v3/users/d6d67e47bc5e426488e35c433aaaf7a5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:17.386014 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:17.387961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:17.402220 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967707b5-cd19-4789-93ad-e5a90955c3e0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:17.461754 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:17.462381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.462663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.462936 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] PATH_INFO: `/v3/projects/45095ca5cc9c433489906a7642ec791e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:17.464060 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45095ca5cc9c433489906a7642ec791e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:17.466199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:17.501990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:17.515665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45095ca5cc9c433489906a7642ec791e', 'request_id': 'req-e217e59f-def8-4725-9b5e-a54c4c7a15f5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:17.521008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45095ca5cc9c433489906a7642ec791e', 'request_id': 'req-e217e59f-def8-4725-9b5e-a54c4c7a15f5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:17.527229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45095ca5cc9c433489906a7642ec791e', 'request_id': 'req-e217e59f-def8-4725-9b5e-a54c4c7a15f5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:17.539700 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] The token cache is being invalidate because project 45095ca5cc9c433489906a7642ec791e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:17.539990 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:17.540636 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e217e59f-def8-4725-9b5e-a54c4c7a15f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:17.542137 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1169/2333] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:17 2022] DELETE /identity/v3/projects/45095ca5cc9c433489906a7642ec791e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:17.547365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d351f-a146-4f31-bb33-f9de201e2caf None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.547869 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d351f-a146-4f31-bb33-f9de201e2caf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.547975 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d351f-a146-4f31-bb33-f9de201e2caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:17.567585 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-776d351f-a146-4f31-bb33-f9de201e2caf None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:17.568813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-776d351f-a146-4f31-bb33-f9de201e2caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:17.627653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1165/2334] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:17.635141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e1b14-b719-42f4-b462-9da769d481c6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.635431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e1b14-b719-42f4-b462-9da769d481c6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.635706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e1b14-b719-42f4-b462-9da769d481c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:17.655786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dc8e1b14-b719-42f4-b462-9da769d481c6 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:17.657006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dc8e1b14-b719-42f4-b462-9da769d481c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:17.665015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1170/2335] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:17.669293 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d351f-a146-4f31-bb33-f9de201e2caf None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:17.678823 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d351f-a146-4f31-bb33-f9de201e2caf None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:17.683366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2456-5b9b-4f90-be3f-1bdd5d304cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:17.684512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2456-5b9b-4f90-be3f-1bdd5d304cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.684785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2456-5b9b-4f90-be3f-1bdd5d304cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.685056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2456-5b9b-4f90-be3f-1bdd5d304cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:17.685698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2456-5b9b-4f90-be3f-1bdd5d304cbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:17.685999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2456-5b9b-4f90-be3f-1bdd5d304cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:17.687580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2456-5b9b-4f90-be3f-1bdd5d304cbc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:17.698810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1166/2336] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:43:17.703501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e1b14-b719-42f4-b462-9da769d481c6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:17.712745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e1b14-b719-42f4-b462-9da769d481c6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:17.717400 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69749830-dad8-460e-a114-2a91f4126d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:17.717985 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749830-dad8-460e-a114-2a91f4126d4d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.718262 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749830-dad8-460e-a114-2a91f4126d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.718529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69749830-dad8-460e-a114-2a91f4126d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:17.719155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69749830-dad8-460e-a114-2a91f4126d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:17.721069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69749830-dad8-460e-a114-2a91f4126d4d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:17.747746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1171/2337] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:17 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:17.751932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2456-5b9b-4f90-be3f-1bdd5d304cbc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:17.761784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2456-5b9b-4f90-be3f-1bdd5d304cbc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:17.819381 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff6497-c2a9-40f7-a9b5-272ef1dece76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:17.819986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6497-c2a9-40f7-a9b5-272ef1dece76 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.820267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6497-c2a9-40f7-a9b5-272ef1dece76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.820570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6497-c2a9-40f7-a9b5-272ef1dece76 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:17.821194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff6497-c2a9-40f7-a9b5-272ef1dece76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:17.823095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff6497-c2a9-40f7-a9b5-272ef1dece76 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:17.844032 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1167/2338] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:17 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:17.848153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69749830-dad8-460e-a114-2a91f4126d4d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:17.859056 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69749830-dad8-460e-a114-2a91f4126d4d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:17.863618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66e41c-c352-476c-bab9-a73cc5e2c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:17.864206 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66e41c-c352-476c-bab9-a73cc5e2c885 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.864512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66e41c-c352-476c-bab9-a73cc5e2c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.864791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66e41c-c352-476c-bab9-a73cc5e2c885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:17.865438 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66e41c-c352-476c-bab9-a73cc5e2c885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:17.867007 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66e41c-c352-476c-bab9-a73cc5e2c885 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:17.877787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1172/2339] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:17.881671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff6497-c2a9-40f7-a9b5-272ef1dece76 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:17.891617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff6497-c2a9-40f7-a9b5-272ef1dece76 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:17.896284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2de242-d44a-4d67-812f-06236f976416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:17.896899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2de242-d44a-4d67-812f-06236f976416 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.897178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2de242-d44a-4d67-812f-06236f976416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.897448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2de242-d44a-4d67-812f-06236f976416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:17.898075 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2de242-d44a-4d67-812f-06236f976416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:17.899661 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2de242-d44a-4d67-812f-06236f976416 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:17.910279 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1168/2340] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:17.914169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66e41c-c352-476c-bab9-a73cc5e2c885 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:17.924617 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66e41c-c352-476c-bab9-a73cc5e2c885 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:17.929185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e0e73-2af5-4155-83a2-8b826e3433e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:17.929822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e0e73-2af5-4155-83a2-8b826e3433e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.930104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e0e73-2af5-4155-83a2-8b826e3433e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.930382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e0e73-2af5-4155-83a2-8b826e3433e0 admin admin] PATH_INFO: `/v3/projects/c41faa630ff34b498869bd311c3ed237/users/1b614e35933345ca9cbeb36c8416bd6f/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:17.945912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e0e73-2af5-4155-83a2-8b826e3433e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41faa630ff34b498869bd311c3ed237, user_id=1b614e35933345ca9cbeb36c8416bd6f, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:17.949164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e0e73-2af5-4155-83a2-8b826e3433e0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:17.962274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1173/2341] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:17 2022] PUT /identity/v3/projects/c41faa630ff34b498869bd311c3ed237/users/1b614e35933345ca9cbeb36c8416bd6f/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:17.973984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3344d-0aea-44f7-a2cc-15f6587df039 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:17.974268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3344d-0aea-44f7-a2cc-15f6587df039 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:17.974541 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3344d-0aea-44f7-a2cc-15f6587df039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:18.004088 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-c8d3344d-0aea-44f7-a2cc-15f6587df039 None None] MFA Rules not processed for user `1b614e35933345ca9cbeb36c8416bd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:18.005301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c8d3344d-0aea-44f7-a2cc-15f6587df039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:18.009189 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:18.070949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1169/2342] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:18.075480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e0e73-2af5-4155-83a2-8b826e3433e0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:18.136286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e0e73-2af5-4155-83a2-8b826e3433e0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:18.141179 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a504883-0372-4f34-8d03-1b48f8151776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:18.141780 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a504883-0372-4f34-8d03-1b48f8151776 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:18.142062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a504883-0372-4f34-8d03-1b48f8151776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:18.142339 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a504883-0372-4f34-8d03-1b48f8151776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:18.143002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a504883-0372-4f34-8d03-1b48f8151776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:18.145051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a504883-0372-4f34-8d03-1b48f8151776 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:18.171145 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1174/2343] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:18 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:18.175247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3344d-0aea-44f7-a2cc-15f6587df039 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:18.186529 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3344d-0aea-44f7-a2cc-15f6587df039 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:18.241014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2b58-b95f-49c2-b499-0ead1164857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:18.241617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2b58-b95f-49c2-b499-0ead1164857d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:18.241910 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2b58-b95f-49c2-b499-0ead1164857d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:18.242165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2b58-b95f-49c2-b499-0ead1164857d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:18.242790 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a2b58-b95f-49c2-b499-0ead1164857d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:18.244694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a2b58-b95f-49c2-b499-0ead1164857d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:18.265270 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1170/2344] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:18 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:18.269364 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a504883-0372-4f34-8d03-1b48f8151776 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:18.280250 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a504883-0372-4f34-8d03-1b48f8151776 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:18.285011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058c7b-4876-42ac-85da-562e099c5694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:18.285643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058c7b-4876-42ac-85da-562e099c5694 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:18.285925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058c7b-4876-42ac-85da-562e099c5694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:18.286201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058c7b-4876-42ac-85da-562e099c5694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:18.287186 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058c7b-4876-42ac-85da-562e099c5694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:18.288416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058c7b-4876-42ac-85da-562e099c5694 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:18.300239 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1175/2345] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:18.304217 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2b58-b95f-49c2-b499-0ead1164857d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:18.314200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2b58-b95f-49c2-b499-0ead1164857d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:18.319072 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e714e72-1deb-40b4-a30a-969b473e8df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:18.319857 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e714e72-1deb-40b4-a30a-969b473e8df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:18.320232 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e714e72-1deb-40b4-a30a-969b473e8df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:18.320652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e714e72-1deb-40b4-a30a-969b473e8df1 admin admin] PATH_INFO: `/v3/projects/82d6450fa96445199f761824279eed15/users/e1d2881f1cb5477d90b197072f7d84c4/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:18.341488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e714e72-1deb-40b4-a30a-969b473e8df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d6450fa96445199f761824279eed15, user_id=e1d2881f1cb5477d90b197072f7d84c4, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:18.344178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e714e72-1deb-40b4-a30a-969b473e8df1 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:18.357127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1171/2346] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:18 2022] PUT /identity/v3/projects/82d6450fa96445199f761824279eed15/users/e1d2881f1cb5477d90b197072f7d84c4/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:18.361468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058c7b-4876-42ac-85da-562e099c5694 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:18.371243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058c7b-4876-42ac-85da-562e099c5694 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:18.398921 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:18.429559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4677d-1041-40bb-a8f3-fe84c218d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:18.430161 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4677d-1041-40bb-a8f3-fe84c218d77d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:18.430440 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4677d-1041-40bb-a8f3-fe84c218d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:18.430711 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4677d-1041-40bb-a8f3-fe84c218d77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:18.431341 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4677d-1041-40bb-a8f3-fe84c218d77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:18.432950 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4677d-1041-40bb-a8f3-fe84c218d77d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:18.442801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1176/2347] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:18.447119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e714e72-1deb-40b4-a30a-969b473e8df1 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:18.457410 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e714e72-1deb-40b4-a30a-969b473e8df1 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:18.461960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcbe3b-5b52-44dc-8c6f-5155ed5392c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:18.462603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcbe3b-5b52-44dc-8c6f-5155ed5392c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:18.462885 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcbe3b-5b52-44dc-8c6f-5155ed5392c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:18.463162 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcbe3b-5b52-44dc-8c6f-5155ed5392c8 admin admin] PATH_INFO: `/v3/projects/82d6450fa96445199f761824279eed15/users/e1d2881f1cb5477d90b197072f7d84c4/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:18.465630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcbe3b-5b52-44dc-8c6f-5155ed5392c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d6450fa96445199f761824279eed15, user_id=e1d2881f1cb5477d90b197072f7d84c4, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:18.468247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcbe3b-5b52-44dc-8c6f-5155ed5392c8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:18.478134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1172/2348] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:18 2022] PUT /identity/v3/projects/82d6450fa96445199f761824279eed15/users/e1d2881f1cb5477d90b197072f7d84c4/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:18.489993 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72840a-e8c0-43f5-9385-e59ad3dc1612 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:18.490285 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72840a-e8c0-43f5-9385-e59ad3dc1612 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:18.490563 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72840a-e8c0-43f5-9385-e59ad3dc1612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:18.517801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5e72840a-e8c0-43f5-9385-e59ad3dc1612 None None] MFA Rules not processed for user `e1d2881f1cb5477d90b197072f7d84c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:18.519038 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5e72840a-e8c0-43f5-9385-e59ad3dc1612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:18.585514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1177/2349] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:18.597525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcbe3b-5b52-44dc-8c6f-5155ed5392c8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:18.599281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-cfdcbe3b-5b52-44dc-8c6f-5155ed5392c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:18.657011 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcbe3b-5b52-44dc-8c6f-5155ed5392c8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:18.660657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929b53-f277-4192-b079-e484c99d94aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:18.661258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929b53-f277-4192-b079-e484c99d94aa service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:18.661539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929b53-f277-4192-b079-e484c99d94aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:18.661811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929b53-f277-4192-b079-e484c99d94aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:18.671071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:18.717736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d929b53-f277-4192-b079-e484c99d94aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:18.719161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d929b53-f277-4192-b079-e484c99d94aa service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:18.727865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1173/2350] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:20.080809 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72840a-e8c0-43f5-9385-e59ad3dc1612 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:20.090961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72840a-e8c0-43f5-9385-e59ad3dc1612 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:20.094510 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e8293-cb4d-48b3-b2d1-bc294f507fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:20.095101 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8293-cb4d-48b3-b2d1-bc294f507fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:20.095383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8293-cb4d-48b3-b2d1-bc294f507fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:20.095660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8293-cb4d-48b3-b2d1-bc294f507fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:20.104377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e8293-cb4d-48b3-b2d1-bc294f507fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:20.105843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e8293-cb4d-48b3-b2d1-bc294f507fc5 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:20.115310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1178/2351] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:23.886333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929b53-f277-4192-b079-e484c99d94aa service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:23.948287 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929b53-f277-4192-b079-e484c99d94aa service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:23.952985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:23.953605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:23.953884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:23.954155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] PATH_INFO: `/v3/users/1b614e35933345ca9cbeb36c8416bd6f` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:23.955253 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b614e35933345ca9cbeb36c8416bd6f)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:23.957202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:24.002985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b614e35933345ca9cbeb36c8416bd6f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.003627 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b614e35933345ca9cbeb36c8416bd6f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.010312 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b614e35933345ca9cbeb36c8416bd6f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.010932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b614e35933345ca9cbeb36c8416bd6f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.023739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b614e35933345ca9cbeb36c8416bd6f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.036848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1174/2352] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:23 2022] DELETE /identity/v3/users/1b614e35933345ca9cbeb36c8416bd6f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:24.041806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce92e8b-3e2c-4664-ab35-e45658259930 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:24.042595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce92e8b-3e2c-4664-ab35-e45658259930 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:24.042760 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce92e8b-3e2c-4664-ab35-e45658259930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:24.063349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0ce92e8b-3e2c-4664-ab35-e45658259930 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:24.064603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0ce92e8b-3e2c-4664-ab35-e45658259930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:24.122526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1179/2353] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:24.132256 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:24.133698 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:24.168384 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:24.193014 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebd132-88db-47f6-a213-694b0c29205e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:24.196606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcb19c-a475-4473-a83e-769b70459163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:24.197206 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcb19c-a475-4473-a83e-769b70459163 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:24.197486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcb19c-a475-4473-a83e-769b70459163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:24.197754 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcb19c-a475-4473-a83e-769b70459163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:24.207317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcb19c-a475-4473-a83e-769b70459163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:24.208769 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcb19c-a475-4473-a83e-769b70459163 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:24.218568 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1175/2354] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:24.478738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce92e8b-3e2c-4664-ab35-e45658259930 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:24.480236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0ce92e8b-3e2c-4664-ab35-e45658259930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:24.493573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce92e8b-3e2c-4664-ab35-e45658259930 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:24.498357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:24.498997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:24.499282 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:24.499564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] PATH_INFO: `/v3/projects/c41faa630ff34b498869bd311c3ed237` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:24.507638 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41faa630ff34b498869bd311c3ed237)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:24.509645 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:24.547975 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:24.558779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41faa630ff34b498869bd311c3ed237', 'request_id': 'req-58363524-2ca5-4d65-a48e-6df36e7608d4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.565024 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41faa630ff34b498869bd311c3ed237', 'request_id': 'req-58363524-2ca5-4d65-a48e-6df36e7608d4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.571384 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41faa630ff34b498869bd311c3ed237', 'request_id': 'req-58363524-2ca5-4d65-a48e-6df36e7608d4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.583995 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] The token cache is being invalidate because project c41faa630ff34b498869bd311c3ed237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:24.584311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.584958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.586420 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1180/2355] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:24 2022] DELETE /identity/v3/projects/c41faa630ff34b498869bd311c3ed237 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:24.590400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcb19c-a475-4473-a83e-769b70459163 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:24.599806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcb19c-a475-4473-a83e-769b70459163 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:24.662002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:24.662002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:24.662002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:24.662002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] PATH_INFO: `/v3/users/e1d2881f1cb5477d90b197072f7d84c4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:24.662420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d2881f1cb5477d90b197072f7d84c4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:24.662420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:24.707672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d2881f1cb5477d90b197072f7d84c4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.708319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d2881f1cb5477d90b197072f7d84c4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.715080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d2881f1cb5477d90b197072f7d84c4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.715725 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d2881f1cb5477d90b197072f7d84c4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.727491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0449081b-5373-4e57-bebc-4e959fa45496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d2881f1cb5477d90b197072f7d84c4'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:24.740578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1176/2356] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:24 2022] DELETE /identity/v3/users/e1d2881f1cb5477d90b197072f7d84c4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:25.017013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.018682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:25.032660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58363524-2ca5-4d65-a48e-6df36e7608d4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.091782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.092482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.092709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.092980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] PATH_INFO: `/v3/projects/82d6450fa96445199f761824279eed15` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.094074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d6450fa96445199f761824279eed15)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.095945 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.141643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d6450fa96445199f761824279eed15', 'request_id': 'req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:25.147104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d6450fa96445199f761824279eed15', 'request_id': 'req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:25.153200 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d6450fa96445199f761824279eed15', 'request_id': 'req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:25.165349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] The token cache is being invalidate because project 82d6450fa96445199f761824279eed15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:25.165636 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:25.166245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d18749a3-3cd4-4b4e-8e0f-9ca4c48c5e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:25.167698 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1181/2357] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:25 2022] DELETE /identity/v3/projects/82d6450fa96445199f761824279eed15 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:25.173313 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109892c-7d66-4b7e-a616-16b8bd5cbe4d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.173797 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109892c-7d66-4b7e-a616-16b8bd5cbe4d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.173894 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109892c-7d66-4b7e-a616-16b8bd5cbe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.193705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4109892c-7d66-4b7e-a616-16b8bd5cbe4d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:25.194848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4109892c-7d66-4b7e-a616-16b8bd5cbe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:25.241023 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:25.255339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1177/2358] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:25.263545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609689-6993-4202-ae70-d90be8ea2ca4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.263844 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609689-6993-4202-ae70-d90be8ea2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.264098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609689-6993-4202-ae70-d90be8ea2ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.290340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-17609689-6993-4202-ae70-d90be8ea2ca4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:25.291540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-17609689-6993-4202-ae70-d90be8ea2ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:25.300273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1182/2359] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:25.304635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109892c-7d66-4b7e-a616-16b8bd5cbe4d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.314796 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109892c-7d66-4b7e-a616-16b8bd5cbe4d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.319496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f725d7-d5a8-431a-b2bc-b3adef5185a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.320082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f725d7-d5a8-431a-b2bc-b3adef5185a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.320369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f725d7-d5a8-431a-b2bc-b3adef5185a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.320671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f725d7-d5a8-431a-b2bc-b3adef5185a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.321316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f725d7-d5a8-431a-b2bc-b3adef5185a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:25.321618 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f725d7-d5a8-431a-b2bc-b3adef5185a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.323210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f725d7-d5a8-431a-b2bc-b3adef5185a8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.334967 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1178/2360] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:43:25.339090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17609689-6993-4202-ae70-d90be8ea2ca4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.353704 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17609689-6993-4202-ae70-d90be8ea2ca4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.361773 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae6eb0-f5e0-401f-8368-6d66fd82662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.362373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae6eb0-f5e0-401f-8368-6d66fd82662d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.362679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae6eb0-f5e0-401f-8368-6d66fd82662d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.362948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae6eb0-f5e0-401f-8368-6d66fd82662d admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.363574 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae6eb0-f5e0-401f-8368-6d66fd82662d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.365489 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae6eb0-f5e0-401f-8368-6d66fd82662d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.392561 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1183/2361] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:25 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:25.396889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f725d7-d5a8-431a-b2bc-b3adef5185a8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.408259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f725d7-d5a8-431a-b2bc-b3adef5185a8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.463228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624eac68-f584-4b59-ad60-40fb9e3f5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.463833 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eac68-f584-4b59-ad60-40fb9e3f5534 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.464110 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eac68-f584-4b59-ad60-40fb9e3f5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.464382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eac68-f584-4b59-ad60-40fb9e3f5534 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.465024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624eac68-f584-4b59-ad60-40fb9e3f5534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.467553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624eac68-f584-4b59-ad60-40fb9e3f5534 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.488881 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1179/2362] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:25 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:25.493046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae6eb0-f5e0-401f-8368-6d66fd82662d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.503346 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae6eb0-f5e0-401f-8368-6d66fd82662d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.508151 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74ad97-8b72-4994-957e-2222ea302217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.508857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74ad97-8b72-4994-957e-2222ea302217 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.509138 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74ad97-8b72-4994-957e-2222ea302217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.509409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74ad97-8b72-4994-957e-2222ea302217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.510047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74ad97-8b72-4994-957e-2222ea302217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.511609 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74ad97-8b72-4994-957e-2222ea302217 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.521729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1184/2363] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:25.525512 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624eac68-f584-4b59-ad60-40fb9e3f5534 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.535946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624eac68-f584-4b59-ad60-40fb9e3f5534 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.546662 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f2fca-4dc8-42ca-b824-a9e6139de49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.547307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f2fca-4dc8-42ca-b824-a9e6139de49c admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.547589 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f2fca-4dc8-42ca-b824-a9e6139de49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.547862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f2fca-4dc8-42ca-b824-a9e6139de49c admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.548545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f2fca-4dc8-42ca-b824-a9e6139de49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.550156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f2fca-4dc8-42ca-b824-a9e6139de49c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.561214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1180/2364] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:25.565371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74ad97-8b72-4994-957e-2222ea302217 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.575487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74ad97-8b72-4994-957e-2222ea302217 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.580064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78d1e8-689e-4aa5-95fa-6189735807e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.580734 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78d1e8-689e-4aa5-95fa-6189735807e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.581017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78d1e8-689e-4aa5-95fa-6189735807e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.581290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78d1e8-689e-4aa5-95fa-6189735807e2 admin admin] PATH_INFO: `/v3/projects/dbf99636ea6b4cfd8825af26a1c682ba/users/9d9f794ccd7249bea403d0e558000bcc/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.592846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:25.597412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78d1e8-689e-4aa5-95fa-6189735807e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf99636ea6b4cfd8825af26a1c682ba, user_id=9d9f794ccd7249bea403d0e558000bcc, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.600516 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78d1e8-689e-4aa5-95fa-6189735807e2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.619878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1185/2365] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:25 2022] PUT /identity/v3/projects/dbf99636ea6b4cfd8825af26a1c682ba/users/9d9f794ccd7249bea403d0e558000bcc/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:25.630931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6039d1-7ab0-418d-bd7c-1e2247bab5f4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.631225 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6039d1-7ab0-418d-bd7c-1e2247bab5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.631624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6039d1-7ab0-418d-bd7c-1e2247bab5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.661215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7d6039d1-7ab0-418d-bd7c-1e2247bab5f4 None None] MFA Rules not processed for user `9d9f794ccd7249bea403d0e558000bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:25.662425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7d6039d1-7ab0-418d-bd7c-1e2247bab5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:25.730446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1181/2366] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:25.735680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78d1e8-689e-4aa5-95fa-6189735807e2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.797593 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78d1e8-689e-4aa5-95fa-6189735807e2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.802234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d624a0-0165-4e62-b8b2-64df55ab7c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.802830 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d624a0-0165-4e62-b8b2-64df55ab7c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.803110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d624a0-0165-4e62-b8b2-64df55ab7c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.803377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d624a0-0165-4e62-b8b2-64df55ab7c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.804004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d624a0-0165-4e62-b8b2-64df55ab7c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.805923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d624a0-0165-4e62-b8b2-64df55ab7c3d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.832746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1186/2367] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:25 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:25.837551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6039d1-7ab0-418d-bd7c-1e2247bab5f4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.849271 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6039d1-7ab0-418d-bd7c-1e2247bab5f4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.893075 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:25.906033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9224adb-255b-4aaa-905a-ec1d09e413dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.906636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9224adb-255b-4aaa-905a-ec1d09e413dc admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.906917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9224adb-255b-4aaa-905a-ec1d09e413dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.907191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9224adb-255b-4aaa-905a-ec1d09e413dc admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.907810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9224adb-255b-4aaa-905a-ec1d09e413dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.909742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9224adb-255b-4aaa-905a-ec1d09e413dc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.930402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1182/2368] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:25 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:25.934418 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d624a0-0165-4e62-b8b2-64df55ab7c3d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.944899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d624a0-0165-4e62-b8b2-64df55ab7c3d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.949413 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea96b93-b07e-4f4e-aa86-781fbb08459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.950013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea96b93-b07e-4f4e-aa86-781fbb08459b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.950290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea96b93-b07e-4f4e-aa86-781fbb08459b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.951119 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea96b93-b07e-4f4e-aa86-781fbb08459b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.952008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea96b93-b07e-4f4e-aa86-781fbb08459b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.953631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea96b93-b07e-4f4e-aa86-781fbb08459b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.963865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1187/2369] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:25.968592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9224adb-255b-4aaa-905a-ec1d09e413dc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:25.978294 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9224adb-255b-4aaa-905a-ec1d09e413dc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:25.983048 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f54eca-8c88-4e6e-8d36-55d3382b673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:25.983846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f54eca-8c88-4e6e-8d36-55d3382b673d admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:25.984125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f54eca-8c88-4e6e-8d36-55d3382b673d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:25.984395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f54eca-8c88-4e6e-8d36-55d3382b673d admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:25.985064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f54eca-8c88-4e6e-8d36-55d3382b673d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:25.986660 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f54eca-8c88-4e6e-8d36-55d3382b673d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:25.996289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1183/2370] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:26.000430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea96b93-b07e-4f4e-aa86-781fbb08459b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:26.010224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea96b93-b07e-4f4e-aa86-781fbb08459b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:26.015695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac4905-d403-4cc2-a92e-bcde10e08c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:26.016332 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac4905-d403-4cc2-a92e-bcde10e08c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:26.016658 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac4905-d403-4cc2-a92e-bcde10e08c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:26.016939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac4905-d403-4cc2-a92e-bcde10e08c25 admin admin] PATH_INFO: `/v3/projects/cae5a89cc024493f84d6453a6a012dea/users/d50e585d3cc7437797d66a1f1f80579d/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:26.032236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac4905-d403-4cc2-a92e-bcde10e08c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae5a89cc024493f84d6453a6a012dea, user_id=d50e585d3cc7437797d66a1f1f80579d, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:26.034989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac4905-d403-4cc2-a92e-bcde10e08c25 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:26.048270 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1188/2371] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:25 2022] PUT /identity/v3/projects/cae5a89cc024493f84d6453a6a012dea/users/d50e585d3cc7437797d66a1f1f80579d/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:26.113694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ff7e-cc8f-4859-88b7-0f83a82670d0 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:26.113983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ff7e-cc8f-4859-88b7-0f83a82670d0 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:26.114259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47ff7e-cc8f-4859-88b7-0f83a82670d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:26.143156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8f47ff7e-cc8f-4859-88b7-0f83a82670d0 None None] MFA Rules not processed for user `d50e585d3cc7437797d66a1f1f80579d`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:26.144370 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8f47ff7e-cc8f-4859-88b7-0f83a82670d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:26.208352 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1184/2372] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:26.212949 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac4905-d403-4cc2-a92e-bcde10e08c25 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:26.274898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac4905-d403-4cc2-a92e-bcde10e08c25 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:26.279529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb032a-4c79-450a-a6bb-12883dc5f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:26.280118 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb032a-4c79-450a-a6bb-12883dc5f513 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:26.280395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb032a-4c79-450a-a6bb-12883dc5f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:26.280691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb032a-4c79-450a-a6bb-12883dc5f513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:26.281321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb032a-4c79-450a-a6bb-12883dc5f513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:26.283201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb032a-4c79-450a-a6bb-12883dc5f513 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:26.308281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1189/2373] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:26 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:26.312958 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ff7e-cc8f-4859-88b7-0f83a82670d0 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:26.323483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47ff7e-cc8f-4859-88b7-0f83a82670d0 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:26.381027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f28a3e-1588-4319-ae37-4c18b3c5ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:26.381614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f28a3e-1588-4319-ae37-4c18b3c5ea4b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:26.381909 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f28a3e-1588-4319-ae37-4c18b3c5ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:26.382166 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f28a3e-1588-4319-ae37-4c18b3c5ea4b admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:26.382783 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f28a3e-1588-4319-ae37-4c18b3c5ea4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:26.384722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f28a3e-1588-4319-ae37-4c18b3c5ea4b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:26.406196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1185/2374] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:26 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:26.410227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb032a-4c79-450a-a6bb-12883dc5f513 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:26.421004 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb032a-4c79-450a-a6bb-12883dc5f513 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:26.425573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e063df-18a2-4709-87ac-b6e6aa0a35c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:26.426164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e063df-18a2-4709-87ac-b6e6aa0a35c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:26.426446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e063df-18a2-4709-87ac-b6e6aa0a35c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:26.426718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e063df-18a2-4709-87ac-b6e6aa0a35c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:26.427353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e063df-18a2-4709-87ac-b6e6aa0a35c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:26.428965 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e063df-18a2-4709-87ac-b6e6aa0a35c5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:26.439869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1190/2375] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:26.443920 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f28a3e-1588-4319-ae37-4c18b3c5ea4b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:26.454044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f28a3e-1588-4319-ae37-4c18b3c5ea4b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:26.458721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440080b1-2788-440f-8aae-a5b56151d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:26.459365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440080b1-2788-440f-8aae-a5b56151d27a admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:26.459649 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440080b1-2788-440f-8aae-a5b56151d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:26.459927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440080b1-2788-440f-8aae-a5b56151d27a admin admin] PATH_INFO: `/v3/projects/28138cef9a4b43ac90ec8eecc0fc763c/users/dff3e992923144fb89d8591e369865dd/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:26.474674 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440080b1-2788-440f-8aae-a5b56151d27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28138cef9a4b43ac90ec8eecc0fc763c, user_id=dff3e992923144fb89d8591e369865dd, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:26.477362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440080b1-2788-440f-8aae-a5b56151d27a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:26.490685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1186/2376] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:26 2022] PUT /identity/v3/projects/28138cef9a4b43ac90ec8eecc0fc763c/users/dff3e992923144fb89d8591e369865dd/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:26.494689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e063df-18a2-4709-87ac-b6e6aa0a35c5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:26.505223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e063df-18a2-4709-87ac-b6e6aa0a35c5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:26.514080 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:26.562541 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26c56a-e05d-41d6-be6b-8da183c4854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:26.563069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26c56a-e05d-41d6-be6b-8da183c4854d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:26.563350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26c56a-e05d-41d6-be6b-8da183c4854d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:26.563621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26c56a-e05d-41d6-be6b-8da183c4854d admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:26.564254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26c56a-e05d-41d6-be6b-8da183c4854d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:26.565863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26c56a-e05d-41d6-be6b-8da183c4854d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:26.575426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1191/2377] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:26.579694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440080b1-2788-440f-8aae-a5b56151d27a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:26.590080 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440080b1-2788-440f-8aae-a5b56151d27a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:26.595169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360863fd-49d5-4df0-a8f5-182e8d07e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:26.595814 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360863fd-49d5-4df0-a8f5-182e8d07e52c admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:26.596100 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360863fd-49d5-4df0-a8f5-182e8d07e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:26.596374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360863fd-49d5-4df0-a8f5-182e8d07e52c admin admin] PATH_INFO: `/v3/projects/28138cef9a4b43ac90ec8eecc0fc763c/users/dff3e992923144fb89d8591e369865dd/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:26.598383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360863fd-49d5-4df0-a8f5-182e8d07e52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=28138cef9a4b43ac90ec8eecc0fc763c, user_id=dff3e992923144fb89d8591e369865dd, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:26.601045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360863fd-49d5-4df0-a8f5-182e8d07e52c admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:26.611954 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1187/2378] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:26 2022] PUT /identity/v3/projects/28138cef9a4b43ac90ec8eecc0fc763c/users/dff3e992923144fb89d8591e369865dd/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:26.621846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eaba1-72c2-41e8-a283-35b0d22040bc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:26.622130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eaba1-72c2-41e8-a283-35b0d22040bc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:26.622402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eaba1-72c2-41e8-a283-35b0d22040bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:26.649890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a77eaba1-72c2-41e8-a283-35b0d22040bc None None] MFA Rules not processed for user `dff3e992923144fb89d8591e369865dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:26.651070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a77eaba1-72c2-41e8-a283-35b0d22040bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:26.719797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1192/2379] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:26.730416 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360863fd-49d5-4df0-a8f5-182e8d07e52c admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:26.732992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-360863fd-49d5-4df0-a8f5-182e8d07e52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:26.743904 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:26.796093 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360863fd-49d5-4df0-a8f5-182e8d07e52c admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:26.800145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4337a2c-7bda-4a30-872c-6d76e380ad9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:26.800868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4337a2c-7bda-4a30-872c-6d76e380ad9f service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:26.801147 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4337a2c-7bda-4a30-872c-6d76e380ad9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:26.801431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4337a2c-7bda-4a30-872c-6d76e380ad9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:26.811159 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4337a2c-7bda-4a30-872c-6d76e380ad9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:26.812665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4337a2c-7bda-4a30-872c-6d76e380ad9f service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:26.822602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1188/2380] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:27.360524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eaba1-72c2-41e8-a283-35b0d22040bc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:27.370073 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eaba1-72c2-41e8-a283-35b0d22040bc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:27.374256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9c733-bcfe-46f4-9be5-74787cb24445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:27.374849 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9c733-bcfe-46f4-9be5-74787cb24445 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:27.375129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9c733-bcfe-46f4-9be5-74787cb24445 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:27.375402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9c733-bcfe-46f4-9be5-74787cb24445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:27.432776 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9c733-bcfe-46f4-9be5-74787cb24445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:27.434202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9c733-bcfe-46f4-9be5-74787cb24445 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:27.443944 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1193/2381] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:31.466193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4337a2c-7bda-4a30-872c-6d76e380ad9f service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:31.467724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b4337a2c-7bda-4a30-872c-6d76e380ad9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:31.478770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4337a2c-7bda-4a30-872c-6d76e380ad9f service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:31.482382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05f2e0-a8e6-4f84-96c1-3568f32c5a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:31.482966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05f2e0-a8e6-4f84-96c1-3568f32c5a3b service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:31.483493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05f2e0-a8e6-4f84-96c1-3568f32c5a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:31.483761 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05f2e0-a8e6-4f84-96c1-3568f32c5a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:31.539219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05f2e0-a8e6-4f84-96c1-3568f32c5a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:31.540675 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05f2e0-a8e6-4f84-96c1-3568f32c5a3b service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:31.549408 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1189/2382] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:33.711106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9c733-bcfe-46f4-9be5-74787cb24445 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:33.749861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:33.788120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9c733-bcfe-46f4-9be5-74787cb24445 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:33.794598 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:33.795227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:33.795503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:33.795772 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] PATH_INFO: `/v3/users/9d9f794ccd7249bea403d0e558000bcc` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:33.797029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9f794ccd7249bea403d0e558000bcc)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:33.798924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:33.850677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9f794ccd7249bea403d0e558000bcc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:33.851330 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9f794ccd7249bea403d0e558000bcc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:33.859237 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9f794ccd7249bea403d0e558000bcc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:33.866641 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9f794ccd7249bea403d0e558000bcc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:33.867264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9f794ccd7249bea403d0e558000bcc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:33.887111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1194/2383] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:33 2022] DELETE /identity/v3/users/9d9f794ccd7249bea403d0e558000bcc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:33.892381 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655a8d7-4fa3-42a4-b02a-3983c369a0bd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:33.892912 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655a8d7-4fa3-42a4-b02a-3983c369a0bd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:33.893030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655a8d7-4fa3-42a4-b02a-3983c369a0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:33.913230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4655a8d7-4fa3-42a4-b02a-3983c369a0bd None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:33.914455 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4655a8d7-4fa3-42a4-b02a-3983c369a0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:33.985599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1190/2384] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:33.995525 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:33.997158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:34.063046 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ab634-e54b-4130-8ac5-2a196dd1cfc0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:34.067175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53028bef-1731-430e-b1a2-cfe675108614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:34.067805 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53028bef-1731-430e-b1a2-cfe675108614 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:34.068087 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53028bef-1731-430e-b1a2-cfe675108614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:34.068362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53028bef-1731-430e-b1a2-cfe675108614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:34.078062 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53028bef-1731-430e-b1a2-cfe675108614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:34.079620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53028bef-1731-430e-b1a2-cfe675108614 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:34.090458 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1195/2385] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:34.381493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655a8d7-4fa3-42a4-b02a-3983c369a0bd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:34.382928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4655a8d7-4fa3-42a4-b02a-3983c369a0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:34.395251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655a8d7-4fa3-42a4-b02a-3983c369a0bd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:34.399892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:34.400563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:34.400849 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:34.401128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] PATH_INFO: `/v3/projects/dbf99636ea6b4cfd8825af26a1c682ba` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:34.402258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf99636ea6b4cfd8825af26a1c682ba)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:34.404840 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:34.451986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:34.455099 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf99636ea6b4cfd8825af26a1c682ba', 'request_id': 'req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:34.463852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf99636ea6b4cfd8825af26a1c682ba', 'request_id': 'req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:34.471103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf99636ea6b4cfd8825af26a1c682ba', 'request_id': 'req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:34.484318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] The token cache is being invalidate because project dbf99636ea6b4cfd8825af26a1c682ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:34.484637 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:34.485286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:34.486810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1191/2386] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:34 2022] DELETE /identity/v3/projects/dbf99636ea6b4cfd8825af26a1c682ba => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:34.491021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53028bef-1731-430e-b1a2-cfe675108614 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:34.502252 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53028bef-1731-430e-b1a2-cfe675108614 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:34.553023 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:34.563264 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:34.564103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:34.565090 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:34.565684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] PATH_INFO: `/v3/users/d50e585d3cc7437797d66a1f1f80579d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:34.567265 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50e585d3cc7437797d66a1f1f80579d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:34.569405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:34.616755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50e585d3cc7437797d66a1f1f80579d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:34.617404 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50e585d3cc7437797d66a1f1f80579d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:34.624184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50e585d3cc7437797d66a1f1f80579d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:34.631215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50e585d3cc7437797d66a1f1f80579d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:34.631863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50e585d3cc7437797d66a1f1f80579d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:34.649009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1196/2387] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:34 2022] DELETE /identity/v3/users/d50e585d3cc7437797d66a1f1f80579d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:34.925170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:34.926642 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:34.940532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb9e5-42e0-4ec3-b57d-3035c3043dab admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:34.999810 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:35.000491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:35.000772 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:35.001125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] PATH_INFO: `/v3/projects/cae5a89cc024493f84d6453a6a012dea` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:35.002238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae5a89cc024493f84d6453a6a012dea)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:35.004179 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:35.051883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae5a89cc024493f84d6453a6a012dea', 'request_id': 'req-5777ce5f-2e76-4253-b6bb-4ea235e463cb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.059276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae5a89cc024493f84d6453a6a012dea', 'request_id': 'req-5777ce5f-2e76-4253-b6bb-4ea235e463cb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.065278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae5a89cc024493f84d6453a6a012dea', 'request_id': 'req-5777ce5f-2e76-4253-b6bb-4ea235e463cb'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.077121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] The token cache is being invalidate because project cae5a89cc024493f84d6453a6a012dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:35.077405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.078028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.079498 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1192/2388] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:34 2022] DELETE /identity/v3/projects/cae5a89cc024493f84d6453a6a012dea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:35.083439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:35.084939 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:35.097358 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593312a-213c-49a1-9770-dfd6512a5c8a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:35.152357 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:35.152999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:35.153278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:35.153550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] PATH_INFO: `/v3/users/dff3e992923144fb89d8591e369865dd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:35.154657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff3e992923144fb89d8591e369865dd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:35.156575 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:35.199694 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff3e992923144fb89d8591e369865dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.200922 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff3e992923144fb89d8591e369865dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.207684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff3e992923144fb89d8591e369865dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.214801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff3e992923144fb89d8591e369865dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.215413 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ba65533b-2501-4c66-b512-e6756728e6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff3e992923144fb89d8591e369865dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.225549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:35.235220 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1197/2389] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:35 2022] DELETE /identity/v3/users/dff3e992923144fb89d8591e369865dd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:35.762237 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:35.765154 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:35.784620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777ce5f-2e76-4253-b6bb-4ea235e463cb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:35.844484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:35.845220 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:35.845521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:35.845789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] PATH_INFO: `/v3/projects/28138cef9a4b43ac90ec8eecc0fc763c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:35.847025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] RBAC: Authorizing `identity:delete_project(project_id=28138cef9a4b43ac90ec8eecc0fc763c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:35.849132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:35.855692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:35.897171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28138cef9a4b43ac90ec8eecc0fc763c', 'request_id': 'req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.904366 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28138cef9a4b43ac90ec8eecc0fc763c', 'request_id': 'req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.909850 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28138cef9a4b43ac90ec8eecc0fc763c', 'request_id': 'req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.921506 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] The token cache is being invalidate because project 28138cef9a4b43ac90ec8eecc0fc763c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:35.921800 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.922544 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-747d7e21-9c93-40e7-a3ff-5320a7b3c3af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:35.924020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1193/2390] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:35 2022] DELETE /identity/v3/projects/28138cef9a4b43ac90ec8eecc0fc763c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:35.930016 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368767b-8e1c-4b63-92a5-ce7499bcb70c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:35.930310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368767b-8e1c-4b63-92a5-ce7499bcb70c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:35.930585 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368767b-8e1c-4b63-92a5-ce7499bcb70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:35.950626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e368767b-8e1c-4b63-92a5-ce7499bcb70c None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:35.951856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e368767b-8e1c-4b63-92a5-ce7499bcb70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:36.011789 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1198/2391] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:36.022161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febd72b-d6b8-4bc2-ba4c-5a6f56d847cd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.022640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febd72b-d6b8-4bc2-ba4c-5a6f56d847cd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.022756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febd72b-d6b8-4bc2-ba4c-5a6f56d847cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.043679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-8febd72b-d6b8-4bc2-ba4c-5a6f56d847cd None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:36.044946 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-8febd72b-d6b8-4bc2-ba4c-5a6f56d847cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:36.052865 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1194/2392] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:36.057092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368767b-8e1c-4b63-92a5-ce7499bcb70c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.067192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368767b-8e1c-4b63-92a5-ce7499bcb70c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.072041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69561a5-3520-470c-986e-65bdb0acb921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.072689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69561a5-3520-470c-986e-65bdb0acb921 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.072970 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69561a5-3520-470c-986e-65bdb0acb921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.073287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69561a5-3520-470c-986e-65bdb0acb921 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.073935 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69561a5-3520-470c-986e-65bdb0acb921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:36.074240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69561a5-3520-470c-986e-65bdb0acb921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.076503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69561a5-3520-470c-986e-65bdb0acb921 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.088287 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1199/2393] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:43:36.092798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febd72b-d6b8-4bc2-ba4c-5a6f56d847cd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.102291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febd72b-d6b8-4bc2-ba4c-5a6f56d847cd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.106921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb04ac6-fbbd-4d95-8298-e0381242117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.107599 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb04ac6-fbbd-4d95-8298-e0381242117e admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.107877 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb04ac6-fbbd-4d95-8298-e0381242117e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.108402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb04ac6-fbbd-4d95-8298-e0381242117e admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.109056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb04ac6-fbbd-4d95-8298-e0381242117e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.110931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb04ac6-fbbd-4d95-8298-e0381242117e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.139717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1195/2394] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:36 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:36.143951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69561a5-3520-470c-986e-65bdb0acb921 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.153828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69561a5-3520-470c-986e-65bdb0acb921 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.209295 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d75de6-c4db-4cde-976d-a1b83e4769cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.209894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75de6-c4db-4cde-976d-a1b83e4769cd admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.210176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75de6-c4db-4cde-976d-a1b83e4769cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.210452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75de6-c4db-4cde-976d-a1b83e4769cd admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.211136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d75de6-c4db-4cde-976d-a1b83e4769cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.213164 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d75de6-c4db-4cde-976d-a1b83e4769cd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.234269 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1200/2395] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:36 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:36.238465 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb04ac6-fbbd-4d95-8298-e0381242117e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.250079 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb04ac6-fbbd-4d95-8298-e0381242117e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.254784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f05d8c-9b29-4f25-82b1-464b67fbe658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.255400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f05d8c-9b29-4f25-82b1-464b67fbe658 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.255719 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f05d8c-9b29-4f25-82b1-464b67fbe658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.256020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f05d8c-9b29-4f25-82b1-464b67fbe658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.256749 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f05d8c-9b29-4f25-82b1-464b67fbe658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.258340 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f05d8c-9b29-4f25-82b1-464b67fbe658 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.269169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1196/2396] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:36.273055 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d75de6-c4db-4cde-976d-a1b83e4769cd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.283621 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d75de6-c4db-4cde-976d-a1b83e4769cd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.288141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c8c94-0303-4068-b30d-58ea5eaf3ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.288756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8c94-0303-4068-b30d-58ea5eaf3ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.289036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8c94-0303-4068-b30d-58ea5eaf3ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.289308 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c8c94-0303-4068-b30d-58ea5eaf3ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.289938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c8c94-0303-4068-b30d-58ea5eaf3ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.291495 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c8c94-0303-4068-b30d-58ea5eaf3ca3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.303600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1201/2397] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:36.307631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f05d8c-9b29-4f25-82b1-464b67fbe658 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.318331 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f05d8c-9b29-4f25-82b1-464b67fbe658 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.323049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93cf47-0622-4b37-aeaf-06260c7b60da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.323717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93cf47-0622-4b37-aeaf-06260c7b60da admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.323977 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93cf47-0622-4b37-aeaf-06260c7b60da admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.324246 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93cf47-0622-4b37-aeaf-06260c7b60da admin admin] PATH_INFO: `/v3/projects/596ef44a9da74a9f93228c8aa7034d6b/users/65bf5028bec544e1b29b30a64e07bde5/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.338490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93cf47-0622-4b37-aeaf-06260c7b60da admin admin] RBAC: Authorizing `identity:create_grant(project_id=596ef44a9da74a9f93228c8aa7034d6b, user_id=65bf5028bec544e1b29b30a64e07bde5, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.341206 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93cf47-0622-4b37-aeaf-06260c7b60da admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.354731 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1197/2398] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:36 2022] PUT /identity/v3/projects/596ef44a9da74a9f93228c8aa7034d6b/users/65bf5028bec544e1b29b30a64e07bde5/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:36.367124 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1448eab-181f-46e7-88d0-687df9fff33a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.367411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1448eab-181f-46e7-88d0-687df9fff33a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.367686 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1448eab-181f-46e7-88d0-687df9fff33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.395064 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c1448eab-181f-46e7-88d0-687df9fff33a None None] MFA Rules not processed for user `65bf5028bec544e1b29b30a64e07bde5`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:36.396261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c1448eab-181f-46e7-88d0-687df9fff33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:36.442003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:36.461053 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1202/2399] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:36 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:36.465632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93cf47-0622-4b37-aeaf-06260c7b60da admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.526201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93cf47-0622-4b37-aeaf-06260c7b60da admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.531767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f9d89-0ca0-43b6-ad56-ed611160c363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.532374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f9d89-0ca0-43b6-ad56-ed611160c363 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.532685 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f9d89-0ca0-43b6-ad56-ed611160c363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.532964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f9d89-0ca0-43b6-ad56-ed611160c363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.533652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f9d89-0ca0-43b6-ad56-ed611160c363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.535584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f9d89-0ca0-43b6-ad56-ed611160c363 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.563170 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1198/2400] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:36 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:36.567169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1448eab-181f-46e7-88d0-687df9fff33a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.578174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1448eab-181f-46e7-88d0-687df9fff33a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.637677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61d8d-3bff-41e7-8f65-bf28bdefcf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.638551 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61d8d-3bff-41e7-8f65-bf28bdefcf60 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.638834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61d8d-3bff-41e7-8f65-bf28bdefcf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.639104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61d8d-3bff-41e7-8f65-bf28bdefcf60 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.639741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61d8d-3bff-41e7-8f65-bf28bdefcf60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.641924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61d8d-3bff-41e7-8f65-bf28bdefcf60 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.664960 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1203/2401] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:36 2022] POST /identity/v3/users => generated 311 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:36.669701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f9d89-0ca0-43b6-ad56-ed611160c363 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.680139 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f9d89-0ca0-43b6-ad56-ed611160c363 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.685026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4050570-8023-46a6-9646-c18b1e821a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.685626 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4050570-8023-46a6-9646-c18b1e821a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.685906 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4050570-8023-46a6-9646-c18b1e821a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.686185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4050570-8023-46a6-9646-c18b1e821a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.686821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4050570-8023-46a6-9646-c18b1e821a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.688449 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4050570-8023-46a6-9646-c18b1e821a35 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.698905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1199/2402] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:36.703201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61d8d-3bff-41e7-8f65-bf28bdefcf60 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.712956 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61d8d-3bff-41e7-8f65-bf28bdefcf60 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.718177 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21631d39-70e3-4858-b808-7483c5d13d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.718831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631d39-70e3-4858-b808-7483c5d13d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.719097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631d39-70e3-4858-b808-7483c5d13d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.719373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631d39-70e3-4858-b808-7483c5d13d27 admin admin] PATH_INFO: `/v3/projects/3e5f95a209b74299aa0e729e576d9782/users/be0b85d767424aa98dddad68aad6df0a/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.734781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21631d39-70e3-4858-b808-7483c5d13d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5f95a209b74299aa0e729e576d9782, user_id=be0b85d767424aa98dddad68aad6df0a, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.737462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21631d39-70e3-4858-b808-7483c5d13d27 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.750324 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1204/2403] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:36 2022] PUT /identity/v3/projects/3e5f95a209b74299aa0e729e576d9782/users/be0b85d767424aa98dddad68aad6df0a/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:36.754427 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4050570-8023-46a6-9646-c18b1e821a35 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.760995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:36.765093 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4050570-8023-46a6-9646-c18b1e821a35 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.821579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88261c-7f4e-42c7-9b3a-9c763d8cea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.822187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88261c-7f4e-42c7-9b3a-9c763d8cea7f admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.822466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88261c-7f4e-42c7-9b3a-9c763d8cea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.822731 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88261c-7f4e-42c7-9b3a-9c763d8cea7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.823358 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88261c-7f4e-42c7-9b3a-9c763d8cea7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.824991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88261c-7f4e-42c7-9b3a-9c763d8cea7f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.834991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1200/2404] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:36.839203 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21631d39-70e3-4858-b808-7483c5d13d27 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.849687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21631d39-70e3-4858-b808-7483c5d13d27 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:36.854225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562fca8-e24b-4dd5-a8cb-6e50b27b0516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:36.854864 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562fca8-e24b-4dd5-a8cb-6e50b27b0516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.855141 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562fca8-e24b-4dd5-a8cb-6e50b27b0516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.855412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562fca8-e24b-4dd5-a8cb-6e50b27b0516 admin admin] PATH_INFO: `/v3/projects/3e5f95a209b74299aa0e729e576d9782/users/be0b85d767424aa98dddad68aad6df0a/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.858345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562fca8-e24b-4dd5-a8cb-6e50b27b0516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5f95a209b74299aa0e729e576d9782, user_id=be0b85d767424aa98dddad68aad6df0a, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:36.861245 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562fca8-e24b-4dd5-a8cb-6e50b27b0516 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:36.871509 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1205/2405] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:36 2022] PUT /identity/v3/projects/3e5f95a209b74299aa0e729e576d9782/users/be0b85d767424aa98dddad68aad6df0a/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:36.883535 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107bf0-f411-4079-9e03-1a9da88071d4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:36.883830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107bf0-f411-4079-9e03-1a9da88071d4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:36.884109 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107bf0-f411-4079-9e03-1a9da88071d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:36.912927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-3d107bf0-f411-4079-9e03-1a9da88071d4 None None] MFA Rules not processed for user `be0b85d767424aa98dddad68aad6df0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:36.914140 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3d107bf0-f411-4079-9e03-1a9da88071d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:36.985151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1201/2406] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:36 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:36.996057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562fca8-e24b-4dd5-a8cb-6e50b27b0516 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:36.997804 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1562fca8-e24b-4dd5-a8cb-6e50b27b0516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:37.056226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562fca8-e24b-4dd5-a8cb-6e50b27b0516 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:37.059911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33883-c842-4028-b9e2-e07f40bd1cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:37.060554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33883-c842-4028-b9e2-e07f40bd1cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:37.060839 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33883-c842-4028-b9e2-e07f40bd1cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:37.061121 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c33883-c842-4028-b9e2-e07f40bd1cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:37.070383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c33883-c842-4028-b9e2-e07f40bd1cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:37.071817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c33883-c842-4028-b9e2-e07f40bd1cd8 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:37.081719 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1206/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:36 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:37.229133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d107bf0-f411-4079-9e03-1a9da88071d4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:37.239163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d107bf0-f411-4079-9e03-1a9da88071d4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:37.242665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c9f7b-b235-466d-a1c7-f8c9cc5fbe92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:37.243280 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c9f7b-b235-466d-a1c7-f8c9cc5fbe92 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:37.243567 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c9f7b-b235-466d-a1c7-f8c9cc5fbe92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:37.243844 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c9f7b-b235-466d-a1c7-f8c9cc5fbe92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:37.301339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c9f7b-b235-466d-a1c7-f8c9cc5fbe92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:37.302779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c9f7b-b235-466d-a1c7-f8c9cc5fbe92 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:37.312282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1202/2408] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:37 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:37.686553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33883-c842-4028-b9e2-e07f40bd1cd8 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:37.687989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-46c33883-c842-4028-b9e2-e07f40bd1cd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:37.733916 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:37.754000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c33883-c842-4028-b9e2-e07f40bd1cd8 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:37.758501 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:37.759063 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:37.759341 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:37.759613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] PATH_INFO: `/v3/users/a60c332e77bb49f688a2188dbe54c81c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:37.760756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60c332e77bb49f688a2188dbe54c81c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:37.762838 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:37.806993 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60c332e77bb49f688a2188dbe54c81c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:37.807885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60c332e77bb49f688a2188dbe54c81c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:37.815380 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60c332e77bb49f688a2188dbe54c81c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:37.822882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60c332e77bb49f688a2188dbe54c81c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:37.823573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60c332e77bb49f688a2188dbe54c81c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:37.841304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1207/2409] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:37 2022] DELETE /identity/v3/users/a60c332e77bb49f688a2188dbe54c81c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:37.845809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f4f60-68c6-44a6-bb78-6c36fab5176f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:37.846097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f4f60-68c6-44a6-bb78-6c36fab5176f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:37.846474 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f4f60-68c6-44a6-bb78-6c36fab5176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:37.866856 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-346f4f60-68c6-44a6-bb78-6c36fab5176f None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:37.868052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-346f4f60-68c6-44a6-bb78-6c36fab5176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:37.886998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:37.930961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1203/2410] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:37.941938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:37.943352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:38.004010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efe3a9-46a6-4ea3-b303-2c03a50a833c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:38.007655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2569b-c40b-4bb5-b9eb-e615fa8d8016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:38.008261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2569b-c40b-4bb5-b9eb-e615fa8d8016 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:38.008622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2569b-c40b-4bb5-b9eb-e615fa8d8016 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:38.008846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2569b-c40b-4bb5-b9eb-e615fa8d8016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:38.018397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2569b-c40b-4bb5-b9eb-e615fa8d8016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:38.019818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2569b-c40b-4bb5-b9eb-e615fa8d8016 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:38.030716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1208/2411] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:38.367357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f4f60-68c6-44a6-bb78-6c36fab5176f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:38.368849 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-346f4f60-68c6-44a6-bb78-6c36fab5176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:38.381582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f4f60-68c6-44a6-bb78-6c36fab5176f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:38.386785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:38.387445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:38.387789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:38.388609 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] PATH_INFO: `/v3/projects/c719187968ba4756a6bc20304375c277` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:38.389758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c719187968ba4756a6bc20304375c277)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:38.391700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:38.448153 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c719187968ba4756a6bc20304375c277', 'request_id': 'req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:38.455218 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c719187968ba4756a6bc20304375c277', 'request_id': 'req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:38.461239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c719187968ba4756a6bc20304375c277', 'request_id': 'req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:38.472648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] The token cache is being invalidate because project c719187968ba4756a6bc20304375c277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:38.472939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:38.473579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-d2c7da50-b5cf-4ce1-b010-70fc2dd5b6f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:38.475094 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1204/2412] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:38 2022] DELETE /identity/v3/projects/c719187968ba4756a6bc20304375c277 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:38.479900 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a11e3-5ecd-4a8b-b757-4d5804a1ee43 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:38.480187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a11e3-5ecd-4a8b-b757-4d5804a1ee43 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:38.480469 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a11e3-5ecd-4a8b-b757-4d5804a1ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:38.501284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fb3a11e3-5ecd-4a8b-b757-4d5804a1ee43 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:38.502468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fb3a11e3-5ecd-4a8b-b757-4d5804a1ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:38.559221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1209/2413] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:38.567657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f99566-e976-4593-b5dd-2e20b109ce68 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:38.568107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f99566-e976-4593-b5dd-2e20b109ce68 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:38.568284 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f99566-e976-4593-b5dd-2e20b109ce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:38.588927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-b2f99566-e976-4593-b5dd-2e20b109ce68 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:38.590052 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b2f99566-e976-4593-b5dd-2e20b109ce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:38.598035 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1205/2414] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:38.602259 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a11e3-5ecd-4a8b-b757-4d5804a1ee43 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:38.612655 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a11e3-5ecd-4a8b-b757-4d5804a1ee43 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:38.617171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e13f0-9795-4491-bcef-ce80d73145d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:38.617758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e13f0-9795-4491-bcef-ce80d73145d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:38.618035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e13f0-9795-4491-bcef-ce80d73145d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:38.618303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e13f0-9795-4491-bcef-ce80d73145d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:38.618942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e13f0-9795-4491-bcef-ce80d73145d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:38.619276 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e13f0-9795-4491-bcef-ce80d73145d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:38.620881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e13f0-9795-4491-bcef-ce80d73145d2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:38.623273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:38.639292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1210/2415] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 03:43:38.640485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f99566-e976-4593-b5dd-2e20b109ce68 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:38.649874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f99566-e976-4593-b5dd-2e20b109ce68 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:38.654987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df04b19-09a0-4a75-b467-4afecb6bee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:38.655595 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df04b19-09a0-4a75-b467-4afecb6bee2b admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:38.655869 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df04b19-09a0-4a75-b467-4afecb6bee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:38.656138 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df04b19-09a0-4a75-b467-4afecb6bee2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:38.656792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df04b19-09a0-4a75-b467-4afecb6bee2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:38.658654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df04b19-09a0-4a75-b467-4afecb6bee2b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:38.691543 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1206/2416] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:38 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:38.692998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e13f0-9795-4491-bcef-ce80d73145d2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:38.703444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e13f0-9795-4491-bcef-ce80d73145d2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:38.772315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81e8a0-e051-4529-8806-74c749681e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:38.772968 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81e8a0-e051-4529-8806-74c749681e2b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:38.773254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81e8a0-e051-4529-8806-74c749681e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:38.773620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81e8a0-e051-4529-8806-74c749681e2b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:38.774577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81e8a0-e051-4529-8806-74c749681e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:38.776584 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81e8a0-e051-4529-8806-74c749681e2b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:38.806289 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1211/2417] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:38 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:38.807602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df04b19-09a0-4a75-b467-4afecb6bee2b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:38.819241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df04b19-09a0-4a75-b467-4afecb6bee2b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:38.825521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857dcef-929e-436d-a132-4b11c9ed88d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:38.826550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857dcef-929e-436d-a132-4b11c9ed88d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:38.826841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857dcef-929e-436d-a132-4b11c9ed88d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:38.827118 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857dcef-929e-436d-a132-4b11c9ed88d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:38.827766 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857dcef-929e-436d-a132-4b11c9ed88d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:38.829399 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857dcef-929e-436d-a132-4b11c9ed88d0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:38.855457 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1207/2418] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:38.857249 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81e8a0-e051-4529-8806-74c749681e2b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:38.871103 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81e8a0-e051-4529-8806-74c749681e2b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:38.873745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03503cb-a88a-48e0-9444-6db6a53d37c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:38.874352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03503cb-a88a-48e0-9444-6db6a53d37c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:38.874629 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03503cb-a88a-48e0-9444-6db6a53d37c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:38.874896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03503cb-a88a-48e0-9444-6db6a53d37c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:38.875560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03503cb-a88a-48e0-9444-6db6a53d37c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:38.877172 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03503cb-a88a-48e0-9444-6db6a53d37c1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:38.888766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1212/2419] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:38.893557 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857dcef-929e-436d-a132-4b11c9ed88d0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:38.904433 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857dcef-929e-436d-a132-4b11c9ed88d0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:38.909273 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344ae68-8748-4b3d-b18e-af21624f7ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:38.909923 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344ae68-8748-4b3d-b18e-af21624f7ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:38.910208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344ae68-8748-4b3d-b18e-af21624f7ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:38.910508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344ae68-8748-4b3d-b18e-af21624f7ce0 admin admin] PATH_INFO: `/v3/projects/076b034e943c45489001ce7ffba634d0/users/9c5074a286b84337929be565bcd76bb6/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:38.926587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344ae68-8748-4b3d-b18e-af21624f7ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076b034e943c45489001ce7ffba634d0, user_id=9c5074a286b84337929be565bcd76bb6, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:38.929289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344ae68-8748-4b3d-b18e-af21624f7ce0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:38.942057 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1208/2420] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:38 2022] PUT /identity/v3/projects/076b034e943c45489001ce7ffba634d0/users/9c5074a286b84337929be565bcd76bb6/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:39.007599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3bcfa-31c0-4bf7-bab8-b6bd52200296 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:39.007882 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3bcfa-31c0-4bf7-bab8-b6bd52200296 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:39.008157 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3bcfa-31c0-4bf7-bab8-b6bd52200296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:39.035459 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-61e3bcfa-31c0-4bf7-bab8-b6bd52200296 None None] MFA Rules not processed for user `9c5074a286b84337929be565bcd76bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:39.036682 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-61e3bcfa-31c0-4bf7-bab8-b6bd52200296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:39.099433 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1213/2421] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:39.111620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344ae68-8748-4b3d-b18e-af21624f7ce0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:39.113379 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-3344ae68-8748-4b3d-b18e-af21624f7ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:39.158635 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:39.170835 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344ae68-8748-4b3d-b18e-af21624f7ce0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:39.174846 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c685-97ae-46d8-a067-64be8d050a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:39.175446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c685-97ae-46d8-a067-64be8d050a1e service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:39.175760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c685-97ae-46d8-a067-64be8d050a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:39.175991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c685-97ae-46d8-a067-64be8d050a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:39.184288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c685-97ae-46d8-a067-64be8d050a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:39.185890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c685-97ae-46d8-a067-64be8d050a1e service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:39.194532 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1209/2422] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:42.665857 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3bcfa-31c0-4bf7-bab8-b6bd52200296 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:42.667285 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-61e3bcfa-31c0-4bf7-bab8-b6bd52200296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:42.735452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3bcfa-31c0-4bf7-bab8-b6bd52200296 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:42.740235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:42.740912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:42.741201 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:42.741608 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] PATH_INFO: `/v3/users/65bf5028bec544e1b29b30a64e07bde5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:42.742748 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] RBAC: Authorizing `identity:delete_user(user_id=65bf5028bec544e1b29b30a64e07bde5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:42.744695 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:42.747534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:42.796082 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65bf5028bec544e1b29b30a64e07bde5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:42.796874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65bf5028bec544e1b29b30a64e07bde5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:42.805198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65bf5028bec544e1b29b30a64e07bde5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:42.812953 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65bf5028bec544e1b29b30a64e07bde5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:42.813559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65bf5028bec544e1b29b30a64e07bde5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:42.831315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1214/2423] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:42 2022] DELETE /identity/v3/users/65bf5028bec544e1b29b30a64e07bde5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:42.835811 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1fa2-9dc5-40c5-959d-bcf067d18c03 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:42.836320 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1fa2-9dc5-40c5-959d-bcf067d18c03 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:42.836439 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1fa2-9dc5-40c5-959d-bcf067d18c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:42.856326 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f18b1fa2-9dc5-40c5-959d-bcf067d18c03 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:42.858469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f18b1fa2-9dc5-40c5-959d-bcf067d18c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:42.917821 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1210/2424] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:42.928205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:42.929630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:42.985709 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd04ac-34f2-437f-99fb-38fd4f55701d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:42.989257 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3d8d-73c3-4637-a251-a3ca118d6bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:42.989859 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3d8d-73c3-4637-a251-a3ca118d6bdd service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:42.990136 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3d8d-73c3-4637-a251-a3ca118d6bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:42.990403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3d8d-73c3-4637-a251-a3ca118d6bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:42.999410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3d8d-73c3-4637-a251-a3ca118d6bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:43.000891 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3d8d-73c3-4637-a251-a3ca118d6bdd service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:43.009979 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1215/2425] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:43.280982 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b1fa2-9dc5-40c5-959d-bcf067d18c03 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:43.282458 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f18b1fa2-9dc5-40c5-959d-bcf067d18c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:43.294614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b1fa2-9dc5-40c5-959d-bcf067d18c03 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:43.299648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:43.300283 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:43.300592 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:43.301357 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] PATH_INFO: `/v3/projects/596ef44a9da74a9f93228c8aa7034d6b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:43.302112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] RBAC: Authorizing `identity:delete_project(project_id=596ef44a9da74a9f93228c8aa7034d6b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:43.304000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:43.351533 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596ef44a9da74a9f93228c8aa7034d6b', 'request_id': 'req-27e868ff-84af-41ac-9714-3b0b3d18196a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.358965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596ef44a9da74a9f93228c8aa7034d6b', 'request_id': 'req-27e868ff-84af-41ac-9714-3b0b3d18196a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.364826 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596ef44a9da74a9f93228c8aa7034d6b', 'request_id': 'req-27e868ff-84af-41ac-9714-3b0b3d18196a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.376786 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] The token cache is being invalidate because project 596ef44a9da74a9f93228c8aa7034d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:43.377074 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.377701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.379169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1211/2426] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:43 2022] DELETE /identity/v3/projects/596ef44a9da74a9f93228c8aa7034d6b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:43.383159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3d8d-73c3-4637-a251-a3ca118d6bdd service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:43.393745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3d8d-73c3-4637-a251-a3ca118d6bdd service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:43.452204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:43.452876 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:43.453161 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:43.453437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] PATH_INFO: `/v3/users/be0b85d767424aa98dddad68aad6df0a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:43.454669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0b85d767424aa98dddad68aad6df0a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:43.456677 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:43.487782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:43.510549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0b85d767424aa98dddad68aad6df0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.511359 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0b85d767424aa98dddad68aad6df0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.520078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0b85d767424aa98dddad68aad6df0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.529286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0b85d767424aa98dddad68aad6df0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.530439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-87c12038-b358-4767-8da5-f17d85abe2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0b85d767424aa98dddad68aad6df0a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.548765 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1216/2427] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:43 2022] DELETE /identity/v3/users/be0b85d767424aa98dddad68aad6df0a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:43.848869 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:43.851086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:43.872889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e868ff-84af-41ac-9714-3b0b3d18196a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:43.930546 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:43.931175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:43.931511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:43.931787 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] PATH_INFO: `/v3/projects/3e5f95a209b74299aa0e729e576d9782` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:43.932926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5f95a209b74299aa0e729e576d9782)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:43.935622 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:43.947824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:43.985363 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5f95a209b74299aa0e729e576d9782', 'request_id': 'req-767fa04b-c857-4bd9-8163-ea7ed9f5302a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.992731 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5f95a209b74299aa0e729e576d9782', 'request_id': 'req-767fa04b-c857-4bd9-8163-ea7ed9f5302a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:43.999510 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5f95a209b74299aa0e729e576d9782', 'request_id': 'req-767fa04b-c857-4bd9-8163-ea7ed9f5302a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:44.010504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] The token cache is being invalidate because project 3e5f95a209b74299aa0e729e576d9782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:44.010791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:44.011428 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-767fa04b-c857-4bd9-8163-ea7ed9f5302a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:44.013240 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1212/2428] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:43 2022] DELETE /identity/v3/projects/3e5f95a209b74299aa0e729e576d9782 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:44.018020 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aed35-b2f3-4f18-af8d-c03d5bd5e998 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:44.018534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aed35-b2f3-4f18-af8d-c03d5bd5e998 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:44.018649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aed35-b2f3-4f18-af8d-c03d5bd5e998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:44.038998 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5b1aed35-b2f3-4f18-af8d-c03d5bd5e998 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:44.040115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5b1aed35-b2f3-4f18-af8d-c03d5bd5e998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:44.102070 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1217/2429] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:44.111105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5ef54-33c0-43b7-a4db-bab3e010487d None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:44.111396 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5ef54-33c0-43b7-a4db-bab3e010487d None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:44.111672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5ef54-33c0-43b7-a4db-bab3e010487d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:44.131484 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-93e5ef54-33c0-43b7-a4db-bab3e010487d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:44.132718 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-93e5ef54-33c0-43b7-a4db-bab3e010487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:44.140791 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1213/2430] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:44.144920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aed35-b2f3-4f18-af8d-c03d5bd5e998 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:44.155109 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aed35-b2f3-4f18-af8d-c03d5bd5e998 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:44.159693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829d8c-974f-4573-9f3e-9ddf69b74b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:44.160280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829d8c-974f-4573-9f3e-9ddf69b74b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:44.160595 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829d8c-974f-4573-9f3e-9ddf69b74b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:44.160870 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829d8c-974f-4573-9f3e-9ddf69b74b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:44.161509 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829d8c-974f-4573-9f3e-9ddf69b74b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:44.161808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829d8c-974f-4573-9f3e-9ddf69b74b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:44.163390 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829d8c-974f-4573-9f3e-9ddf69b74b70 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:44.176559 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1218/2431] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:43:44.180862 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5ef54-33c0-43b7-a4db-bab3e010487d None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:44.190181 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5ef54-33c0-43b7-a4db-bab3e010487d None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:44.194830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d666eb-c276-41ed-b30f-597da4cb1385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:44.195424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d666eb-c276-41ed-b30f-597da4cb1385 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:44.195705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d666eb-c276-41ed-b30f-597da4cb1385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:44.195980 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d666eb-c276-41ed-b30f-597da4cb1385 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:44.196679 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d666eb-c276-41ed-b30f-597da4cb1385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:44.198563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d666eb-c276-41ed-b30f-597da4cb1385 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:44.225175 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1214/2432] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:44 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:44.229292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829d8c-974f-4573-9f3e-9ddf69b74b70 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:44.240027 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829d8c-974f-4573-9f3e-9ddf69b74b70 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:44.296100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc116-2f29-4758-9450-b0221dc14b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:44.296666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc116-2f29-4758-9450-b0221dc14b52 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:44.296952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc116-2f29-4758-9450-b0221dc14b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:44.297226 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc116-2f29-4758-9450-b0221dc14b52 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:44.297850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fc116-2f29-4758-9450-b0221dc14b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:44.299761 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fc116-2f29-4758-9450-b0221dc14b52 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:44.320403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1219/2433] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:44 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:44.324569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d666eb-c276-41ed-b30f-597da4cb1385 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:44.334691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d666eb-c276-41ed-b30f-597da4cb1385 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:44.339276 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68304d-4511-430f-8872-999ee7c89b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:44.339868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68304d-4511-430f-8872-999ee7c89b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:44.340151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68304d-4511-430f-8872-999ee7c89b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:44.340425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68304d-4511-430f-8872-999ee7c89b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:44.341616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68304d-4511-430f-8872-999ee7c89b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:44.343216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68304d-4511-430f-8872-999ee7c89b59 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:44.352926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1215/2434] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:44.357686 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc116-2f29-4758-9450-b0221dc14b52 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:44.368291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc116-2f29-4758-9450-b0221dc14b52 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:44.373002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46880c1-487b-499d-8852-fa4e7d818acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:44.373592 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46880c1-487b-499d-8852-fa4e7d818acb admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:44.373871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46880c1-487b-499d-8852-fa4e7d818acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:44.374142 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46880c1-487b-499d-8852-fa4e7d818acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:44.374804 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46880c1-487b-499d-8852-fa4e7d818acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:44.376367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46880c1-487b-499d-8852-fa4e7d818acb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:44.388000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1220/2435] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:44.392251 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68304d-4511-430f-8872-999ee7c89b59 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:44.402173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68304d-4511-430f-8872-999ee7c89b59 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:44.407417 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2626319-a75e-4bf5-b831-75dfc00dd1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:44.408062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626319-a75e-4bf5-b831-75dfc00dd1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:44.408345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626319-a75e-4bf5-b831-75dfc00dd1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:44.408653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626319-a75e-4bf5-b831-75dfc00dd1c4 admin admin] PATH_INFO: `/v3/projects/183a79e5e36c4b019407492b8b977925/users/c7afb10035094316bff80728da510a17/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:44.423616 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2626319-a75e-4bf5-b831-75dfc00dd1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183a79e5e36c4b019407492b8b977925, user_id=c7afb10035094316bff80728da510a17, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:44.426301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2626319-a75e-4bf5-b831-75dfc00dd1c4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:44.439197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1216/2436] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:44 2022] PUT /identity/v3/projects/183a79e5e36c4b019407492b8b977925/users/c7afb10035094316bff80728da510a17/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:44.449471 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471fb6b-a332-4578-bf4f-0faeb6437c35 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:44.449754 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471fb6b-a332-4578-bf4f-0faeb6437c35 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:44.450618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471fb6b-a332-4578-bf4f-0faeb6437c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:44.470564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:44.480756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6471fb6b-a332-4578-bf4f-0faeb6437c35 None None] MFA Rules not processed for user `c7afb10035094316bff80728da510a17`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:44.482205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6471fb6b-a332-4578-bf4f-0faeb6437c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:44.546764 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1221/2437] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:44.557553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2626319-a75e-4bf5-b831-75dfc00dd1c4 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:44.559628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d2626319-a75e-4bf5-b831-75dfc00dd1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:44.621828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2626319-a75e-4bf5-b831-75dfc00dd1c4 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:44.625604 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ec6a-9055-4d93-98e9-c731f06327e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:44.626211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ec6a-9055-4d93-98e9-c731f06327e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:44.626488 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ec6a-9055-4d93-98e9-c731f06327e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:44.626755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ec6a-9055-4d93-98e9-c731f06327e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:44.634917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423ec6a-9055-4d93-98e9-c731f06327e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:44.636331 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423ec6a-9055-4d93-98e9-c731f06327e4 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:44.645632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1217/2438] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:44.990263 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471fb6b-a332-4578-bf4f-0faeb6437c35 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:44.991691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6471fb6b-a332-4578-bf4f-0faeb6437c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:45.050676 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471fb6b-a332-4578-bf4f-0faeb6437c35 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:45.054208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d7d83-dd71-4d0b-bcad-9a03e9a20de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:45.054841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d7d83-dd71-4d0b-bcad-9a03e9a20de9 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:45.055115 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d7d83-dd71-4d0b-bcad-9a03e9a20de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:45.055406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d7d83-dd71-4d0b-bcad-9a03e9a20de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:45.057161 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a85d7d83-dd71-4d0b-bcad-9a03e9a20de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:45.119831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d7d83-dd71-4d0b-bcad-9a03e9a20de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:45.121258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d7d83-dd71-4d0b-bcad-9a03e9a20de9 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:45.131918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1222/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:43:48.537204 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ec6a-9055-4d93-98e9-c731f06327e4 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:48.539345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7423ec6a-9055-4d93-98e9-c731f06327e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:48.561005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ec6a-9055-4d93-98e9-c731f06327e4 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:48.565470 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:48.566112 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:48.566531 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:48.566805 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] PATH_INFO: `/v3/users/78ca6fbbda31433bbe598ce667103cae` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:48.568001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ca6fbbda31433bbe598ce667103cae)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:48.569964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:48.612290 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:48.623411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ca6fbbda31433bbe598ce667103cae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:48.624887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ca6fbbda31433bbe598ce667103cae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:48.634632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ca6fbbda31433bbe598ce667103cae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:48.635330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ca6fbbda31433bbe598ce667103cae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:48.648689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-3eb8e1b9-6cd9-4124-9e8b-62cbcde46630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ca6fbbda31433bbe598ce667103cae'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:48.662158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1218/2440] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:48 2022] DELETE /identity/v3/users/78ca6fbbda31433bbe598ce667103cae => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:48.844191 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d7d83-dd71-4d0b-bcad-9a03e9a20de9 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:48.858917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d7d83-dd71-4d0b-bcad-9a03e9a20de9 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:48.906298 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:48.917898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:48.919058 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:48.919378 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:48.919743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] PATH_INFO: `/v3/projects/6d203394b8aa4b5aaed0f15cfa2664f0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:48.920888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d203394b8aa4b5aaed0f15cfa2664f0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:48.922766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:48.968424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d203394b8aa4b5aaed0f15cfa2664f0', 'request_id': 'req-d54a3552-e45e-4096-ae82-7e20b8fd927f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:48.974019 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d203394b8aa4b5aaed0f15cfa2664f0', 'request_id': 'req-d54a3552-e45e-4096-ae82-7e20b8fd927f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:48.980650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d203394b8aa4b5aaed0f15cfa2664f0', 'request_id': 'req-d54a3552-e45e-4096-ae82-7e20b8fd927f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:48.993806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] The token cache is being invalidate because project 6d203394b8aa4b5aaed0f15cfa2664f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:48.994102 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:48.994738 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d54a3552-e45e-4096-ae82-7e20b8fd927f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:48.996215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1223/2441] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:48 2022] DELETE /identity/v3/projects/6d203394b8aa4b5aaed0f15cfa2664f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:49.001851 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae19de-3c7a-45bf-880c-0316ff689328 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.002140 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae19de-3c7a-45bf-880c-0316ff689328 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.002413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae19de-3c7a-45bf-880c-0316ff689328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.024078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-56ae19de-3c7a-45bf-880c-0316ff689328 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:49.025351 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-56ae19de-3c7a-45bf-880c-0316ff689328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:49.091119 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1219/2442] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:49.099140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d145b-d01e-4d18-b9ef-9d4a00b0f75d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.099425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d145b-d01e-4d18-b9ef-9d4a00b0f75d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.099903 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d145b-d01e-4d18-b9ef-9d4a00b0f75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.125307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-592d145b-d01e-4d18-b9ef-9d4a00b0f75d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:49.126511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-592d145b-d01e-4d18-b9ef-9d4a00b0f75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:49.136508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1224/2443] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:49.141569 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae19de-3c7a-45bf-880c-0316ff689328 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.151405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae19de-3c7a-45bf-880c-0316ff689328 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.156524 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d51de0-2086-4119-aebb-8eee0b4178e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.157134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d51de0-2086-4119-aebb-8eee0b4178e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.157436 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d51de0-2086-4119-aebb-8eee0b4178e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.157715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d51de0-2086-4119-aebb-8eee0b4178e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.158480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d51de0-2086-4119-aebb-8eee0b4178e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:49.158789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d51de0-2086-4119-aebb-8eee0b4178e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.160444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d51de0-2086-4119-aebb-8eee0b4178e7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.176681 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1220/2444] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:43:49.177980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d145b-d01e-4d18-b9ef-9d4a00b0f75d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.188085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d145b-d01e-4d18-b9ef-9d4a00b0f75d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.192756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09077f2d-a75d-46cc-ab9a-73785bb3290a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.193345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09077f2d-a75d-46cc-ab9a-73785bb3290a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.193650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09077f2d-a75d-46cc-ab9a-73785bb3290a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.193917 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09077f2d-a75d-46cc-ab9a-73785bb3290a admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.194545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09077f2d-a75d-46cc-ab9a-73785bb3290a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.196417 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09077f2d-a75d-46cc-ab9a-73785bb3290a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.231568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1225/2445] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:49 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:49.236345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d51de0-2086-4119-aebb-8eee0b4178e7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.246101 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d51de0-2086-4119-aebb-8eee0b4178e7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.303745 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50191f-ae27-42b6-b469-1fde9fe2325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.304310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50191f-ae27-42b6-b469-1fde9fe2325d admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.304620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50191f-ae27-42b6-b469-1fde9fe2325d admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.304897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50191f-ae27-42b6-b469-1fde9fe2325d admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.305522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50191f-ae27-42b6-b469-1fde9fe2325d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.307457 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50191f-ae27-42b6-b469-1fde9fe2325d admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.327353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1221/2446] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:49 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:49.331782 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09077f2d-a75d-46cc-ab9a-73785bb3290a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.342372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09077f2d-a75d-46cc-ab9a-73785bb3290a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.346911 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ecad-06a1-4072-90da-84be20af58b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.347500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ecad-06a1-4072-90da-84be20af58b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.347778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ecad-06a1-4072-90da-84be20af58b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.348049 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ecad-06a1-4072-90da-84be20af58b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.348725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ecad-06a1-4072-90da-84be20af58b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.350304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ecad-06a1-4072-90da-84be20af58b6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.361125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1226/2447] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:49.365360 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50191f-ae27-42b6-b469-1fde9fe2325d admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.375964 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50191f-ae27-42b6-b469-1fde9fe2325d admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.380762 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207edbb-b6e9-447f-bb0c-7a11e9a7d0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.381361 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207edbb-b6e9-447f-bb0c-7a11e9a7d0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.381641 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207edbb-b6e9-447f-bb0c-7a11e9a7d0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.381913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207edbb-b6e9-447f-bb0c-7a11e9a7d0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.382553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207edbb-b6e9-447f-bb0c-7a11e9a7d0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.384160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207edbb-b6e9-447f-bb0c-7a11e9a7d0f7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.395558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1222/2448] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:49.400010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ecad-06a1-4072-90da-84be20af58b6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.411035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ecad-06a1-4072-90da-84be20af58b6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.415643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c9e0d-1b30-405b-93ae-986e00b3203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.416291 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c9e0d-1b30-405b-93ae-986e00b3203a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.416605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c9e0d-1b30-405b-93ae-986e00b3203a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.416884 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c9e0d-1b30-405b-93ae-986e00b3203a admin admin] PATH_INFO: `/v3/projects/95be6a86bb88479b9788d1bdda5f3ab5/users/5194da39ae0749f69e7255ec63cf87c3/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.431934 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c9e0d-1b30-405b-93ae-986e00b3203a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95be6a86bb88479b9788d1bdda5f3ab5, user_id=5194da39ae0749f69e7255ec63cf87c3, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.434602 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c9e0d-1b30-405b-93ae-986e00b3203a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.447460 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1227/2449] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:49 2022] PUT /identity/v3/projects/95be6a86bb88479b9788d1bdda5f3ab5/users/5194da39ae0749f69e7255ec63cf87c3/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:49.459342 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814d5d2-933e-47c1-9883-37e107bf20bb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.459634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814d5d2-933e-47c1-9883-37e107bf20bb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.459933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814d5d2-933e-47c1-9883-37e107bf20bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.489016 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-4814d5d2-933e-47c1-9883-37e107bf20bb None None] MFA Rules not processed for user `5194da39ae0749f69e7255ec63cf87c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:49.490268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4814d5d2-933e-47c1-9883-37e107bf20bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:49.495317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:49.556763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1223/2450] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:49.561408 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c9e0d-1b30-405b-93ae-986e00b3203a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.623010 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c9e0d-1b30-405b-93ae-986e00b3203a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.627586 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0adb5-acbb-42c1-b5d0-ea39b4733fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.628182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0adb5-acbb-42c1-b5d0-ea39b4733fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.628486 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0adb5-acbb-42c1-b5d0-ea39b4733fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.628763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0adb5-acbb-42c1-b5d0-ea39b4733fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.629394 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0adb5-acbb-42c1-b5d0-ea39b4733fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.631274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0adb5-acbb-42c1-b5d0-ea39b4733fa9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.642030 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:49.658896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1228/2451] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:49 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:49.663097 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814d5d2-933e-47c1-9883-37e107bf20bb None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.674444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814d5d2-933e-47c1-9883-37e107bf20bb None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.729265 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54944e-571b-4e42-b495-f3a431c44fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.729868 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54944e-571b-4e42-b495-f3a431c44fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.730146 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54944e-571b-4e42-b495-f3a431c44fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.730417 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54944e-571b-4e42-b495-f3a431c44fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.731123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54944e-571b-4e42-b495-f3a431c44fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.733252 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54944e-571b-4e42-b495-f3a431c44fb3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.753553 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1224/2452] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:49 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:49.757643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0adb5-acbb-42c1-b5d0-ea39b4733fa9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.768225 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0adb5-acbb-42c1-b5d0-ea39b4733fa9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.772865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745d9c-2c0e-40e5-88dc-6ab267d3b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.773453 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745d9c-2c0e-40e5-88dc-6ab267d3b2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.773737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745d9c-2c0e-40e5-88dc-6ab267d3b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.774011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745d9c-2c0e-40e5-88dc-6ab267d3b2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.774646 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59745d9c-2c0e-40e5-88dc-6ab267d3b2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.776240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59745d9c-2c0e-40e5-88dc-6ab267d3b2e4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.786848 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1229/2453] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:49.791116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54944e-571b-4e42-b495-f3a431c44fb3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.801266 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54944e-571b-4e42-b495-f3a431c44fb3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.805930 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6fd70-d79e-4af5-9585-4483f6854df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.806580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6fd70-d79e-4af5-9585-4483f6854df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.806859 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6fd70-d79e-4af5-9585-4483f6854df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.807133 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6fd70-d79e-4af5-9585-4483f6854df6 admin admin] PATH_INFO: `/v3/projects/c9ad22d3855f4ce8a17284cc07fc5bf2/users/c8cb54753f6342408a2127f17d035865/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.822652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6fd70-d79e-4af5-9585-4483f6854df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ad22d3855f4ce8a17284cc07fc5bf2, user_id=c8cb54753f6342408a2127f17d035865, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.826173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6fd70-d79e-4af5-9585-4483f6854df6 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.844230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1225/2454] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:49 2022] PUT /identity/v3/projects/c9ad22d3855f4ce8a17284cc07fc5bf2/users/c8cb54753f6342408a2127f17d035865/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:49.845347 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745d9c-2c0e-40e5-88dc-6ab267d3b2e4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.855537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745d9c-2c0e-40e5-88dc-6ab267d3b2e4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.938068 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee49e9-151d-4dc5-b152-df44a4cbbc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.938679 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee49e9-151d-4dc5-b152-df44a4cbbc41 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.938962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee49e9-151d-4dc5-b152-df44a4cbbc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.939236 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee49e9-151d-4dc5-b152-df44a4cbbc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.939877 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee49e9-151d-4dc5-b152-df44a4cbbc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.941482 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee49e9-151d-4dc5-b152-df44a4cbbc41 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.955092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1230/2455] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:49.956214 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6fd70-d79e-4af5-9585-4483f6854df6 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:49.967307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6fd70-d79e-4af5-9585-4483f6854df6 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:49.972013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daffdb-4fae-4be2-be6a-232d8a00ab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:49.972702 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daffdb-4fae-4be2-be6a-232d8a00ab19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.972988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daffdb-4fae-4be2-be6a-232d8a00ab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.973266 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daffdb-4fae-4be2-be6a-232d8a00ab19 admin admin] PATH_INFO: `/v3/projects/c9ad22d3855f4ce8a17284cc07fc5bf2/users/c8cb54753f6342408a2127f17d035865/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:49.975200 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29daffdb-4fae-4be2-be6a-232d8a00ab19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ad22d3855f4ce8a17284cc07fc5bf2, user_id=c8cb54753f6342408a2127f17d035865, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:49.977902 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29daffdb-4fae-4be2-be6a-232d8a00ab19 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:49.988799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1226/2456] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:49 2022] PUT /identity/v3/projects/c9ad22d3855f4ce8a17284cc07fc5bf2/users/c8cb54753f6342408a2127f17d035865/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:49.999283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a745e47-86e0-4231-94bc-70d0e8760a16 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:49.999580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a745e47-86e0-4231-94bc-70d0e8760a16 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:49.999861 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a745e47-86e0-4231-94bc-70d0e8760a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:50.028834 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5a745e47-86e0-4231-94bc-70d0e8760a16 None None] MFA Rules not processed for user `c8cb54753f6342408a2127f17d035865`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:50.030314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a745e47-86e0-4231-94bc-70d0e8760a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:50.111850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1231/2457] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:50.124292 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daffdb-4fae-4be2-be6a-232d8a00ab19 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:50.126030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-29daffdb-4fae-4be2-be6a-232d8a00ab19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:50.191304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daffdb-4fae-4be2-be6a-232d8a00ab19 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:50.194979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc6e5d-2234-4487-aa2f-eb94467d01c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:50.195582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6e5d-2234-4487-aa2f-eb94467d01c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:50.195861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6e5d-2234-4487-aa2f-eb94467d01c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:50.196128 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6e5d-2234-4487-aa2f-eb94467d01c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:50.206278 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc6e5d-2234-4487-aa2f-eb94467d01c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:50.207696 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc6e5d-2234-4487-aa2f-eb94467d01c0 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:50.217565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1227/2458] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:50.706948 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a745e47-86e0-4231-94bc-70d0e8760a16 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:50.768690 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a745e47-86e0-4231-94bc-70d0e8760a16 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:50.773182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:50.773802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:50.774112 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:50.774385 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] PATH_INFO: `/v3/users/5194da39ae0749f69e7255ec63cf87c3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:50.775498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=5194da39ae0749f69e7255ec63cf87c3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:50.777431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:50.780480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:50.825129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5194da39ae0749f69e7255ec63cf87c3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:50.825785 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5194da39ae0749f69e7255ec63cf87c3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:50.832687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5194da39ae0749f69e7255ec63cf87c3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:50.840184 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5194da39ae0749f69e7255ec63cf87c3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:50.841520 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5194da39ae0749f69e7255ec63cf87c3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:50.860097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1232/2459] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:50 2022] DELETE /identity/v3/users/5194da39ae0749f69e7255ec63cf87c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:50.864624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c59862-3507-4523-9297-b54f4aa08a9e None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:50.865039 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c59862-3507-4523-9297-b54f4aa08a9e None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:50.865186 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c59862-3507-4523-9297-b54f4aa08a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:50.872219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:50.887394 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d3c59862-3507-4523-9297-b54f4aa08a9e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:50.888585 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d3c59862-3507-4523-9297-b54f4aa08a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:50.945763 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1228/2460] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:50.955647 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:50.957192 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:51.015213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2865-366d-4d8b-94bd-cef0dd01e9ed admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:51.019412 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861e8bb-c9a7-4125-8151-e678fe380533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:51.020050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861e8bb-c9a7-4125-8151-e678fe380533 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:51.020335 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861e8bb-c9a7-4125-8151-e678fe380533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:51.020648 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861e8bb-c9a7-4125-8151-e678fe380533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:51.030650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861e8bb-c9a7-4125-8151-e678fe380533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:51.032133 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861e8bb-c9a7-4125-8151-e678fe380533 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:51.042856 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1233/2461] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:43:51.310831 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c59862-3507-4523-9297-b54f4aa08a9e None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:51.312317 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d3c59862-3507-4523-9297-b54f4aa08a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:51.324362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c59862-3507-4523-9297-b54f4aa08a9e None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:51.329378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:51.330025 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:51.330308 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:51.330586 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] PATH_INFO: `/v3/projects/95be6a86bb88479b9788d1bdda5f3ab5` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:51.331730 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=95be6a86bb88479b9788d1bdda5f3ab5)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:51.333697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:51.394938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95be6a86bb88479b9788d1bdda5f3ab5', 'request_id': 'req-a56fb5cd-cd71-40de-860a-ababf6051f6e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:51.403187 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95be6a86bb88479b9788d1bdda5f3ab5', 'request_id': 'req-a56fb5cd-cd71-40de-860a-ababf6051f6e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:51.409231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95be6a86bb88479b9788d1bdda5f3ab5', 'request_id': 'req-a56fb5cd-cd71-40de-860a-ababf6051f6e'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:51.423483 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] The token cache is being invalidate because project 95be6a86bb88479b9788d1bdda5f3ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:51.423848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:51.424539 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:51.426560 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1229/2462] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:51 2022] DELETE /identity/v3/projects/95be6a86bb88479b9788d1bdda5f3ab5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:51.431100 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861e8bb-c9a7-4125-8151-e678fe380533 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:51.442601 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861e8bb-c9a7-4125-8151-e678fe380533 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:51.504888 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:51.505522 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:51.505812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:51.506091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] PATH_INFO: `/v3/users/c8cb54753f6342408a2127f17d035865` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:51.507228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cb54753f6342408a2127f17d035865)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:51.509171 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:51.537951 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:51.559376 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cb54753f6342408a2127f17d035865'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:51.560049 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cb54753f6342408a2127f17d035865'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:51.567411 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cb54753f6342408a2127f17d035865'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:51.576842 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cb54753f6342408a2127f17d035865'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:51.577637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e929d0d-7f67-4154-824c-3b8c9000a0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cb54753f6342408a2127f17d035865'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:51.596218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1234/2463] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:51 2022] DELETE /identity/v3/users/c8cb54753f6342408a2127f17d035865 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:51.916018 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:51.918247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:51.934968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fb5cd-cd71-40de-860a-ababf6051f6e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:51.991831 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:51.992631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:51.992915 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:51.993192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] PATH_INFO: `/v3/projects/c9ad22d3855f4ce8a17284cc07fc5bf2` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:51.994336 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ad22d3855f4ce8a17284cc07fc5bf2)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:51.996237 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.028999 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:52.050755 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ad22d3855f4ce8a17284cc07fc5bf2', 'request_id': 'req-4112b147-563a-4b91-9748-2d8ed8b4edf5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:52.059845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ad22d3855f4ce8a17284cc07fc5bf2', 'request_id': 'req-4112b147-563a-4b91-9748-2d8ed8b4edf5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:52.066387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ad22d3855f4ce8a17284cc07fc5bf2', 'request_id': 'req-4112b147-563a-4b91-9748-2d8ed8b4edf5'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:52.078651 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] The token cache is being invalidate because project c9ad22d3855f4ce8a17284cc07fc5bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:52.078932 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:52.079772 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4112b147-563a-4b91-9748-2d8ed8b4edf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:52.081279 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1230/2464] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:51 2022] DELETE /identity/v3/projects/c9ad22d3855f4ce8a17284cc07fc5bf2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:52.086017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a53360-1181-4ccd-9d5e-dd1514c95bf3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.086499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a53360-1181-4ccd-9d5e-dd1514c95bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.086600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a53360-1181-4ccd-9d5e-dd1514c95bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.106751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c2a53360-1181-4ccd-9d5e-dd1514c95bf3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:52.108215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c2a53360-1181-4ccd-9d5e-dd1514c95bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:52.168078 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1235/2465] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:52.175957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a886827-5e2b-4339-a521-e8f62b0dcad4 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.176247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a886827-5e2b-4339-a521-e8f62b0dcad4 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.176571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a886827-5e2b-4339-a521-e8f62b0dcad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.195672 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0a886827-5e2b-4339-a521-e8f62b0dcad4 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:52.196892 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0a886827-5e2b-4339-a521-e8f62b0dcad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:52.205785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1231/2466] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:52.209997 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a53360-1181-4ccd-9d5e-dd1514c95bf3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.221185 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a53360-1181-4ccd-9d5e-dd1514c95bf3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.225777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31534c46-ecd7-4299-b2ab-047128c1638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:52.226373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31534c46-ecd7-4299-b2ab-047128c1638f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.226650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31534c46-ecd7-4299-b2ab-047128c1638f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.226920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31534c46-ecd7-4299-b2ab-047128c1638f admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.227568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31534c46-ecd7-4299-b2ab-047128c1638f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:43:52.227867 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31534c46-ecd7-4299-b2ab-047128c1638f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:52.229499 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31534c46-ecd7-4299-b2ab-047128c1638f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.242691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1236/2467] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:43:52.247379 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a886827-5e2b-4339-a521-e8f62b0dcad4 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.258054 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a886827-5e2b-4339-a521-e8f62b0dcad4 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.263668 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425736-4ae0-4ee9-adb2-9f109bcd43d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:52.264282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425736-4ae0-4ee9-adb2-9f109bcd43d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.264587 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425736-4ae0-4ee9-adb2-9f109bcd43d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.264856 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425736-4ae0-4ee9-adb2-9f109bcd43d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.265496 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29425736-4ae0-4ee9-adb2-9f109bcd43d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:52.267442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29425736-4ae0-4ee9-adb2-9f109bcd43d8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.300003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1232/2468] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:52 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:43:52.304174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31534c46-ecd7-4299-b2ab-047128c1638f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.314730 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31534c46-ecd7-4299-b2ab-047128c1638f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.373937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666e3cb-89db-4f7d-bde0-30896f496e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:52.374569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666e3cb-89db-4f7d-bde0-30896f496e2b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.375104 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666e3cb-89db-4f7d-bde0-30896f496e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.375372 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666e3cb-89db-4f7d-bde0-30896f496e2b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.376428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666e3cb-89db-4f7d-bde0-30896f496e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:52.378770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666e3cb-89db-4f7d-bde0-30896f496e2b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.401705 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1237/2469] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:52 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:52.406409 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425736-4ae0-4ee9-adb2-9f109bcd43d8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.418017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425736-4ae0-4ee9-adb2-9f109bcd43d8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.422845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2133d9-723b-4927-9d77-d05d6c8538d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:52.423390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2133d9-723b-4927-9d77-d05d6c8538d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.423671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2133d9-723b-4927-9d77-d05d6c8538d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.423940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2133d9-723b-4927-9d77-d05d6c8538d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.424626 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2133d9-723b-4927-9d77-d05d6c8538d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:52.426219 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2133d9-723b-4927-9d77-d05d6c8538d3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.436897 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1233/2470] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:52.441000 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666e3cb-89db-4f7d-bde0-30896f496e2b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.451781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666e3cb-89db-4f7d-bde0-30896f496e2b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.456427 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec26b5-d46c-4a89-a65b-18125330b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:52.457047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec26b5-d46c-4a89-a65b-18125330b6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.457328 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec26b5-d46c-4a89-a65b-18125330b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.457603 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec26b5-d46c-4a89-a65b-18125330b6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.458243 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec26b5-d46c-4a89-a65b-18125330b6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:52.459814 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec26b5-d46c-4a89-a65b-18125330b6c6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.470665 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1238/2471] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:52.475044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2133d9-723b-4927-9d77-d05d6c8538d3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.485530 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2133d9-723b-4927-9d77-d05d6c8538d3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.490129 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc9401-d475-4b70-afc1-66595af8f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:52.490752 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc9401-d475-4b70-afc1-66595af8f83f admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.491028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc9401-d475-4b70-afc1-66595af8f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.491304 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc9401-d475-4b70-afc1-66595af8f83f admin admin] PATH_INFO: `/v3/projects/ef6e4d66b91e442f8ebbd03a03635acf/users/835ae063cbaf4675a48aa4d4bbb5a721/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.506216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc9401-d475-4b70-afc1-66595af8f83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6e4d66b91e442f8ebbd03a03635acf, user_id=835ae063cbaf4675a48aa4d4bbb5a721, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:52.508928 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc9401-d475-4b70-afc1-66595af8f83f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.522033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1234/2472] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:52 2022] PUT /identity/v3/projects/ef6e4d66b91e442f8ebbd03a03635acf/users/835ae063cbaf4675a48aa4d4bbb5a721/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:52.533897 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3848a0-1d67-4f2d-babc-e54007c608e1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.534187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3848a0-1d67-4f2d-babc-e54007c608e1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.534468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3848a0-1d67-4f2d-babc-e54007c608e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.556741 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:52.568530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0e3848a0-1d67-4f2d-babc-e54007c608e1 None None] MFA Rules not processed for user `835ae063cbaf4675a48aa4d4bbb5a721`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:52.570485 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0e3848a0-1d67-4f2d-babc-e54007c608e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:52.634280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1239/2473] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:52.639822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc9401-d475-4b70-afc1-66595af8f83f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.701767 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc9401-d475-4b70-afc1-66595af8f83f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.706424 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50207546-2502-4eb1-ad7b-8b945636066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:52.707030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50207546-2502-4eb1-ad7b-8b945636066e admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.707315 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50207546-2502-4eb1-ad7b-8b945636066e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.707594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50207546-2502-4eb1-ad7b-8b945636066e admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.708222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50207546-2502-4eb1-ad7b-8b945636066e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:52.710167 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50207546-2502-4eb1-ad7b-8b945636066e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.740534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1235/2474] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:43:52 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:52.742120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3848a0-1d67-4f2d-babc-e54007c608e1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.753831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3848a0-1d67-4f2d-babc-e54007c608e1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.816366 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4b0a7-a726-4c99-8273-54b0762c7a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:52.817015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4b0a7-a726-4c99-8273-54b0762c7a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.817297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4b0a7-a726-4c99-8273-54b0762c7a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.817572 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4b0a7-a726-4c99-8273-54b0762c7a8b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.818218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4b0a7-a726-4c99-8273-54b0762c7a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:52.820111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4b0a7-a726-4c99-8273-54b0762c7a8b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.853419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1240/2475] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:43:52 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:43:52.858603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50207546-2502-4eb1-ad7b-8b945636066e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.870585 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50207546-2502-4eb1-ad7b-8b945636066e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.877614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadd11b-4a11-4698-8aeb-5c059d5c6109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:52.878555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadd11b-4a11-4698-8aeb-5c059d5c6109 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.879013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadd11b-4a11-4698-8aeb-5c059d5c6109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.879463 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadd11b-4a11-4698-8aeb-5c059d5c6109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.880568 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadd11b-4a11-4698-8aeb-5c059d5c6109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:52.882838 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadd11b-4a11-4698-8aeb-5c059d5c6109 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.894085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1236/2476] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:43:52.898314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4b0a7-a726-4c99-8273-54b0762c7a8b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.908397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4b0a7-a726-4c99-8273-54b0762c7a8b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.913008 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8463c6-ef1d-40e9-9496-d8f4a80bfdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:52.913649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8463c6-ef1d-40e9-9496-d8f4a80bfdff admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:52.913930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8463c6-ef1d-40e9-9496-d8f4a80bfdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:52.914207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8463c6-ef1d-40e9-9496-d8f4a80bfdff admin admin] PATH_INFO: `/v3/projects/80c37feeec574215837dc82be043a1f3/users/2330fca35e8f450cb566876de47e2a1e/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:52.929346 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8463c6-ef1d-40e9-9496-d8f4a80bfdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c37feeec574215837dc82be043a1f3, user_id=2330fca35e8f450cb566876de47e2a1e, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:52.931976 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8463c6-ef1d-40e9-9496-d8f4a80bfdff admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:52.946310 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1241/2477] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:52 2022] PUT /identity/v3/projects/80c37feeec574215837dc82be043a1f3/users/2330fca35e8f450cb566876de47e2a1e/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:43:52.951620 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadd11b-4a11-4698-8aeb-5c059d5c6109 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:52.962425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadd11b-4a11-4698-8aeb-5c059d5c6109 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:52.988957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:53.026993 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b989ebd-2267-4495-8495-43d239ffddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:53.028126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b989ebd-2267-4495-8495-43d239ffddd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:53.029002 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b989ebd-2267-4495-8495-43d239ffddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:53.029315 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b989ebd-2267-4495-8495-43d239ffddd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:53.029965 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b989ebd-2267-4495-8495-43d239ffddd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:53.031776 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b989ebd-2267-4495-8495-43d239ffddd8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:53.041911 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1237/2478] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:43:53.047371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8463c6-ef1d-40e9-9496-d8f4a80bfdff admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:53.057742 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8463c6-ef1d-40e9-9496-d8f4a80bfdff admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:53.063114 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4853ce-0932-44d4-b2a7-4dd29ea6502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:53.063954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4853ce-0932-44d4-b2a7-4dd29ea6502a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:53.064269 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4853ce-0932-44d4-b2a7-4dd29ea6502a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:53.064640 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4853ce-0932-44d4-b2a7-4dd29ea6502a admin admin] PATH_INFO: `/v3/projects/80c37feeec574215837dc82be043a1f3/users/2330fca35e8f450cb566876de47e2a1e/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:53.066835 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4853ce-0932-44d4-b2a7-4dd29ea6502a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c37feeec574215837dc82be043a1f3, user_id=2330fca35e8f450cb566876de47e2a1e, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:53.070001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4853ce-0932-44d4-b2a7-4dd29ea6502a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:53.082215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1242/2479] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:43:53 2022] PUT /identity/v3/projects/80c37feeec574215837dc82be043a1f3/users/2330fca35e8f450cb566876de47e2a1e/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:53.093629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1469c-791e-4da1-88a2-46a38ea06319 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:53.093916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1469c-791e-4da1-88a2-46a38ea06319 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:53.094221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1469c-791e-4da1-88a2-46a38ea06319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:53.122692 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-60f1469c-791e-4da1-88a2-46a38ea06319 None None] MFA Rules not processed for user `2330fca35e8f450cb566876de47e2a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:53.123890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-60f1469c-791e-4da1-88a2-46a38ea06319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:53.194247 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1238/2480] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:43:53.205732 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4853ce-0932-44d4-b2a7-4dd29ea6502a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:53.207444 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7e4853ce-0932-44d4-b2a7-4dd29ea6502a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:53.264794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4853ce-0932-44d4-b2a7-4dd29ea6502a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:53.268589 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940a68f-a161-4bc2-b997-1b8dedf2d2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:53.269233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a68f-a161-4bc2-b997-1b8dedf2d2fd service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:53.269512 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a68f-a161-4bc2-b997-1b8dedf2d2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:53.269786 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940a68f-a161-4bc2-b997-1b8dedf2d2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:53.275579 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:53.281195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940a68f-a161-4bc2-b997-1b8dedf2d2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:53.282959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940a68f-a161-4bc2-b997-1b8dedf2d2fd service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:53.292747 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1243/2481] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:53.372108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1469c-791e-4da1-88a2-46a38ea06319 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:53.388047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1469c-791e-4da1-88a2-46a38ea06319 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:53.392744 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a15f9-7364-4d68-8655-f316a448c8f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:53.393363 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a15f9-7364-4d68-8655-f316a448c8f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:53.393645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a15f9-7364-4d68-8655-f316a448c8f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:53.393914 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a15f9-7364-4d68-8655-f316a448c8f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:53.449723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a15f9-7364-4d68-8655-f316a448c8f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:53.451756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a15f9-7364-4d68-8655-f316a448c8f6 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:53.460867 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1239/2482] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:55.035949 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940a68f-a161-4bc2-b997-1b8dedf2d2fd service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:55.037409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3940a68f-a161-4bc2-b997-1b8dedf2d2fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:55.102325 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940a68f-a161-4bc2-b997-1b8dedf2d2fd service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:55.106850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:55.107472 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:55.107754 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:55.108280 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] PATH_INFO: `/v3/users/c7afb10035094316bff80728da510a17` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:55.109944 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7afb10035094316bff80728da510a17)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:55.111854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:55.162577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7afb10035094316bff80728da510a17'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:55.163255 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7afb10035094316bff80728da510a17'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:55.170301 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7afb10035094316bff80728da510a17'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:55.177957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7afb10035094316bff80728da510a17'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:55.178635 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7afb10035094316bff80728da510a17'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:55.195871 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1244/2483] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:43:55 2022] DELETE /identity/v3/users/c7afb10035094316bff80728da510a17 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:43:55.200390 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11773d-0bbb-46c2-9e02-f01ac04596fb None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:55.200890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11773d-0bbb-46c2-9e02-f01ac04596fb None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:55.200986 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11773d-0bbb-46c2-9e02-f01ac04596fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:55.221090 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-af11773d-0bbb-46c2-9e02-f01ac04596fb None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:43:55.222315 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-af11773d-0bbb-46c2-9e02-f01ac04596fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:55.271125 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=100 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:43:55.290356 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1240/2484] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:43:55.300521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:55.301927 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:55.359878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6461ab2-8322-470d-8c42-c0dd2d33b41d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:55.363519 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431d95e-3f89-4738-8fa9-5d8078aaece3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:55.364126 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431d95e-3f89-4738-8fa9-5d8078aaece3 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:55.364408 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431d95e-3f89-4738-8fa9-5d8078aaece3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:55.364712 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431d95e-3f89-4738-8fa9-5d8078aaece3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:55.376150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431d95e-3f89-4738-8fa9-5d8078aaece3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:55.377600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431d95e-3f89-4738-8fa9-5d8078aaece3 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:55.386894 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1245/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:43:55.661813 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11773d-0bbb-46c2-9e02-f01ac04596fb None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:43:55.663568 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-af11773d-0bbb-46c2-9e02-f01ac04596fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:43:55.678459 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11773d-0bbb-46c2-9e02-f01ac04596fb None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:43:55.684720 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:43:55.685385 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:43:55.685627 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:43:55.685898 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] PATH_INFO: `/v3/projects/183a79e5e36c4b019407492b8b977925` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:43:55.687690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183a79e5e36c4b019407492b8b977925)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:43:55.689943 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:43:55.739784 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183a79e5e36c4b019407492b8b977925', 'request_id': 'req-378bc64e-8edc-457a-930b-09e3facb4e66'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:55.747020 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183a79e5e36c4b019407492b8b977925', 'request_id': 'req-378bc64e-8edc-457a-930b-09e3facb4e66'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:55.753403 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183a79e5e36c4b019407492b8b977925', 'request_id': 'req-378bc64e-8edc-457a-930b-09e3facb4e66'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:55.764671 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] The token cache is being invalidate because project 183a79e5e36c4b019407492b8b977925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:43:55.764956 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:55.765645 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-378bc64e-8edc-457a-930b-09e3facb4e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:43:55.767210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1241/2486] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:43:55 2022] DELETE /identity/v3/projects/183a79e5e36c4b019407492b8b977925 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:00.700908 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431d95e-3f89-4738-8fa9-5d8078aaece3 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:00.702316 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3431d95e-3f89-4738-8fa9-5d8078aaece3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:00.714988 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431d95e-3f89-4738-8fa9-5d8078aaece3 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:00.728304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:00.775139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:00.775753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:00.776033 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:00.776303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] PATH_INFO: `/v3/users/835ae063cbaf4675a48aa4d4bbb5a721` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:00.777451 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=835ae063cbaf4675a48aa4d4bbb5a721)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:00.779340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:00.827847 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835ae063cbaf4675a48aa4d4bbb5a721'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:00.828437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835ae063cbaf4675a48aa4d4bbb5a721'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:00.835918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835ae063cbaf4675a48aa4d4bbb5a721'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:00.842886 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835ae063cbaf4675a48aa4d4bbb5a721'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:00.843511 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835ae063cbaf4675a48aa4d4bbb5a721'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:00.861513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1246/2487] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:00 2022] DELETE /identity/v3/users/835ae063cbaf4675a48aa4d4bbb5a721 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:00.865992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6eb66-2dff-406e-b3d7-e527a42be727 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:00.866489 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6eb66-2dff-406e-b3d7-e527a42be727 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:00.866596 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6eb66-2dff-406e-b3d7-e527a42be727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:00.886116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-e2f6eb66-2dff-406e-b3d7-e527a42be727 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:00.888160 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e2f6eb66-2dff-406e-b3d7-e527a42be727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:00.947006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1242/2488] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:00.957266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:00.958651 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:01.016578 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f3485-b2b2-4c4a-9021-0fcf1b8384fb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:01.021134 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb49f7-14ea-4865-9f10-98bb7b56c909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:01.021730 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb49f7-14ea-4865-9f10-98bb7b56c909 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:01.022009 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb49f7-14ea-4865-9f10-98bb7b56c909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:01.022279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb49f7-14ea-4865-9f10-98bb7b56c909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:01.031035 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb49f7-14ea-4865-9f10-98bb7b56c909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:01.032441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb49f7-14ea-4865-9f10-98bb7b56c909 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:01.042901 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1247/2489] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:01.319383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6eb66-2dff-406e-b3d7-e527a42be727 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:01.320993 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-e2f6eb66-2dff-406e-b3d7-e527a42be727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:01.343417 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6eb66-2dff-406e-b3d7-e527a42be727 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:01.348327 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:01.348994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:01.349275 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:01.349546 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] PATH_INFO: `/v3/projects/ef6e4d66b91e442f8ebbd03a03635acf` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:01.353333 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6e4d66b91e442f8ebbd03a03635acf)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:01.355817 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:01.407305 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6e4d66b91e442f8ebbd03a03635acf', 'request_id': 'req-4ba1905a-df86-42e0-b7be-43084e151b8a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:01.416935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6e4d66b91e442f8ebbd03a03635acf', 'request_id': 'req-4ba1905a-df86-42e0-b7be-43084e151b8a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:01.423931 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6e4d66b91e442f8ebbd03a03635acf', 'request_id': 'req-4ba1905a-df86-42e0-b7be-43084e151b8a'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:01.425258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:01.438199 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] The token cache is being invalidate because project ef6e4d66b91e442f8ebbd03a03635acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:01.438764 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:01.440365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:01.441916 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1243/2490] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:01 2022] DELETE /identity/v3/projects/ef6e4d66b91e442f8ebbd03a03635acf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:01.446088 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb49f7-14ea-4865-9f10-98bb7b56c909 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:01.456431 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb49f7-14ea-4865-9f10-98bb7b56c909 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:01.492526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:01.516766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:01.518012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:01.518286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:01.518553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] PATH_INFO: `/v3/users/2330fca35e8f450cb566876de47e2a1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:01.519674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2330fca35e8f450cb566876de47e2a1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:01.521583 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:01.573989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2330fca35e8f450cb566876de47e2a1e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:01.574628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2330fca35e8f450cb566876de47e2a1e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:01.581628 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2330fca35e8f450cb566876de47e2a1e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:01.588863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2330fca35e8f450cb566876de47e2a1e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:01.589497 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fbc98e19-a123-477b-bf21-3c21e67df69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2330fca35e8f450cb566876de47e2a1e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:01.607125 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1248/2491] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:01 2022] DELETE /identity/v3/users/2330fca35e8f450cb566876de47e2a1e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:44:01.888803 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:01.890211 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:01.911550 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1905a-df86-42e0-b7be-43084e151b8a admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:01.972315 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:01.972891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:01.973203 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:01.973481 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] PATH_INFO: `/v3/projects/80c37feeec574215837dc82be043a1f3` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:01.974591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c37feeec574215837dc82be043a1f3)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:01.976654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.024121 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c37feeec574215837dc82be043a1f3', 'request_id': 'req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:02.030574 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c37feeec574215837dc82be043a1f3', 'request_id': 'req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:02.036478 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c37feeec574215837dc82be043a1f3', 'request_id': 'req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:02.049321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] The token cache is being invalidate because project 80c37feeec574215837dc82be043a1f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:02.049617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:02.050312 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-fef7e957-4a1f-4a5e-8fcf-4e46c0b48359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:02.052156 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1244/2492] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:01 2022] DELETE /identity/v3/projects/80c37feeec574215837dc82be043a1f3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:02.057303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266371-a038-4ee8-9cdb-ec856d92de81 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.057691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266371-a038-4ee8-9cdb-ec856d92de81 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.057989 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266371-a038-4ee8-9cdb-ec856d92de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.077767 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c5266371-a038-4ee8-9cdb-ec856d92de81 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:02.078977 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c5266371-a038-4ee8-9cdb-ec856d92de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:02.137869 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1249/2493] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:44:02.147126 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b734-8320-4b64-9f03-552067bb5521 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.147409 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b734-8320-4b64-9f03-552067bb5521 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.147682 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b734-8320-4b64-9f03-552067bb5521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.167614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-0eb2b734-8320-4b64-9f03-552067bb5521 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:02.168854 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0eb2b734-8320-4b64-9f03-552067bb5521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:02.177165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1245/2494] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:02.181292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5266371-a038-4ee8-9cdb-ec856d92de81 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.190831 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5266371-a038-4ee8-9cdb-ec856d92de81 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.195326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac58935-1be9-42d8-a1b7-71e42fc312a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.195910 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac58935-1be9-42d8-a1b7-71e42fc312a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.196189 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac58935-1be9-42d8-a1b7-71e42fc312a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.196485 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac58935-1be9-42d8-a1b7-71e42fc312a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.197128 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac58935-1be9-42d8-a1b7-71e42fc312a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:44:02.197430 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac58935-1be9-42d8-a1b7-71e42fc312a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.199002 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac58935-1be9-42d8-a1b7-71e42fc312a4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.211370 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1250/2495] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:44:02.215716 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b734-8320-4b64-9f03-552067bb5521 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.226329 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b734-8320-4b64-9f03-552067bb5521 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.230841 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf03a-c231-4f93-b5c1-938580ad3814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.231442 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf03a-c231-4f93-b5c1-938580ad3814 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.231717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf03a-c231-4f93-b5c1-938580ad3814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.231987 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf03a-c231-4f93-b5c1-938580ad3814 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.232649 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf03a-c231-4f93-b5c1-938580ad3814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.234771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf03a-c231-4f93-b5c1-938580ad3814 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.262090 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1246/2496] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:44:02 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:44:02.266466 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac58935-1be9-42d8-a1b7-71e42fc312a4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.276381 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac58935-1be9-42d8-a1b7-71e42fc312a4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.318074 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:02.335473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cbd21-ddf8-4676-a885-8bb5625373a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.336099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cbd21-ddf8-4676-a885-8bb5625373a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.336363 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cbd21-ddf8-4676-a885-8bb5625373a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.336669 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cbd21-ddf8-4676-a885-8bb5625373a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.337306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cbd21-ddf8-4676-a885-8bb5625373a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.339265 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cbd21-ddf8-4676-a885-8bb5625373a7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.364808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1251/2497] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:44:02 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:02.365974 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf03a-c231-4f93-b5c1-938580ad3814 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.377666 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf03a-c231-4f93-b5c1-938580ad3814 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.382321 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3bf9-1c0e-4ade-8732-097839644818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.382921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3bf9-1c0e-4ade-8732-097839644818 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.383201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3bf9-1c0e-4ade-8732-097839644818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.383475 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3bf9-1c0e-4ade-8732-097839644818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.384116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c3bf9-1c0e-4ade-8732-097839644818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.385741 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c3bf9-1c0e-4ade-8732-097839644818 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.399513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1247/2498] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:02.404267 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cbd21-ddf8-4676-a885-8bb5625373a7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.415182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cbd21-ddf8-4676-a885-8bb5625373a7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.419843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746cd09-7fd0-4da0-9391-bd9832120ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.420437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746cd09-7fd0-4da0-9391-bd9832120ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.420755 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746cd09-7fd0-4da0-9391-bd9832120ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.421031 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746cd09-7fd0-4da0-9391-bd9832120ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.421671 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746cd09-7fd0-4da0-9391-bd9832120ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.423473 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746cd09-7fd0-4da0-9391-bd9832120ac6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.433850 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1252/2499] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:44:02.438043 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3bf9-1c0e-4ade-8732-097839644818 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.448077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3bf9-1c0e-4ade-8732-097839644818 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.452724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8620767-dd23-4596-9b50-431565ced1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.453367 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620767-dd23-4596-9b50-431565ced1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.453653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620767-dd23-4596-9b50-431565ced1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.453933 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620767-dd23-4596-9b50-431565ced1fe admin admin] PATH_INFO: `/v3/projects/f5c27e7fd53a4d33ba28a4ef594334b5/users/6a49fa4575fe4e17bc640f48b5e52f83/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.469772 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8620767-dd23-4596-9b50-431565ced1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c27e7fd53a4d33ba28a4ef594334b5, user_id=6a49fa4575fe4e17bc640f48b5e52f83, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.473195 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8620767-dd23-4596-9b50-431565ced1fe admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.485926 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1248/2500] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:02 2022] PUT /identity/v3/projects/f5c27e7fd53a4d33ba28a4ef594334b5/users/6a49fa4575fe4e17bc640f48b5e52f83/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:02.496120 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a930f-594e-4cb5-a995-0ecaf32efcb4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.496409 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a930f-594e-4cb5-a995-0ecaf32efcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.496733 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a930f-594e-4cb5-a995-0ecaf32efcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.524622 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ba3a930f-594e-4cb5-a995-0ecaf32efcb4 None None] MFA Rules not processed for user `6a49fa4575fe4e17bc640f48b5e52f83`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:02.525829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ba3a930f-594e-4cb5-a995-0ecaf32efcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:02.589448 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1253/2501] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:02.594003 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8620767-dd23-4596-9b50-431565ced1fe admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.615118 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:02.656163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8620767-dd23-4596-9b50-431565ced1fe admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.661369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e15d2b-1039-44a5-8ae9-f5ea0d9491b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.661966 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e15d2b-1039-44a5-8ae9-f5ea0d9491b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.662243 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e15d2b-1039-44a5-8ae9-f5ea0d9491b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.662513 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e15d2b-1039-44a5-8ae9-f5ea0d9491b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.663134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e15d2b-1039-44a5-8ae9-f5ea0d9491b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.665058 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e15d2b-1039-44a5-8ae9-f5ea0d9491b8 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.691407 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1249/2502] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:44:02 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:02.695521 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a930f-594e-4cb5-a995-0ecaf32efcb4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.706654 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a930f-594e-4cb5-a995-0ecaf32efcb4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.761808 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228516d-1851-4d2e-a31a-607180164a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.762340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228516d-1851-4d2e-a31a-607180164a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.762625 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228516d-1851-4d2e-a31a-607180164a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.762902 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228516d-1851-4d2e-a31a-607180164a8b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.763527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228516d-1851-4d2e-a31a-607180164a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.765476 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228516d-1851-4d2e-a31a-607180164a8b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.787517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1254/2503] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:44:02 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:02.791712 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e15d2b-1039-44a5-8ae9-f5ea0d9491b8 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.801970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e15d2b-1039-44a5-8ae9-f5ea0d9491b8 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.806770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12712e-54de-490c-9468-b9346ab29693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.807380 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12712e-54de-490c-9468-b9346ab29693 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.807690 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12712e-54de-490c-9468-b9346ab29693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.807968 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12712e-54de-490c-9468-b9346ab29693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.808643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12712e-54de-490c-9468-b9346ab29693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.810267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12712e-54de-490c-9468-b9346ab29693 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.822037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1250/2504] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:02.826130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228516d-1851-4d2e-a31a-607180164a8b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.837001 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228516d-1851-4d2e-a31a-607180164a8b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.842286 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0932c7-ce06-430b-b3d6-7577df943450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.843057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0932c7-ce06-430b-b3d6-7577df943450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.843344 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0932c7-ce06-430b-b3d6-7577df943450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.843615 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0932c7-ce06-430b-b3d6-7577df943450 admin admin] PATH_INFO: `/v3/projects/aefbc308fb9b4d3caa249488ece26c09/users/6f2bccb67f354092b3f2a4f87dbd6b39/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.859303 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0932c7-ce06-430b-b3d6-7577df943450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefbc308fb9b4d3caa249488ece26c09, user_id=6f2bccb67f354092b3f2a4f87dbd6b39, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.862211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0932c7-ce06-430b-b3d6-7577df943450 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.874397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1255/2505] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:02 2022] PUT /identity/v3/projects/aefbc308fb9b4d3caa249488ece26c09/users/6f2bccb67f354092b3f2a4f87dbd6b39/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:02.878953 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12712e-54de-490c-9468-b9346ab29693 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.888646 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12712e-54de-490c-9468-b9346ab29693 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.943626 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2123b3-16b2-44db-be09-8f46c886c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.944313 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2123b3-16b2-44db-be09-8f46c886c6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.944514 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2123b3-16b2-44db-be09-8f46c886c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.944789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2123b3-16b2-44db-be09-8f46c886c6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.945419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2123b3-16b2-44db-be09-8f46c886c6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.946992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2123b3-16b2-44db-be09-8f46c886c6b4 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.957166 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1251/2506] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:02.961438 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0932c7-ce06-430b-b3d6-7577df943450 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:02.971664 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0932c7-ce06-430b-b3d6-7577df943450 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:02.976300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5f7c-4a0e-40a1-a7ed-efad0038d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:02.976980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5f7c-4a0e-40a1-a7ed-efad0038d8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:02.977261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5f7c-4a0e-40a1-a7ed-efad0038d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:02.977536 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5f7c-4a0e-40a1-a7ed-efad0038d8d5 admin admin] PATH_INFO: `/v3/projects/aefbc308fb9b4d3caa249488ece26c09/users/6f2bccb67f354092b3f2a4f87dbd6b39/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:02.979441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c5f7c-4a0e-40a1-a7ed-efad0038d8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefbc308fb9b4d3caa249488ece26c09, user_id=6f2bccb67f354092b3f2a4f87dbd6b39, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:02.982089 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c5f7c-4a0e-40a1-a7ed-efad0038d8d5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:02.992749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1256/2507] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:02 2022] PUT /identity/v3/projects/aefbc308fb9b4d3caa249488ece26c09/users/6f2bccb67f354092b3f2a4f87dbd6b39/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:03.003994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25396f5-3201-47ca-9437-a250f9ef439f None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:03.004281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25396f5-3201-47ca-9437-a250f9ef439f None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:03.004591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25396f5-3201-47ca-9437-a250f9ef439f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:03.034884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f25396f5-3201-47ca-9437-a250f9ef439f None None] MFA Rules not processed for user `6f2bccb67f354092b3f2a4f87dbd6b39`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:03.036120 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f25396f5-3201-47ca-9437-a250f9ef439f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:03.106456 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1252/2508] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:03.118041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5f7c-4a0e-40a1-a7ed-efad0038d8d5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:03.119840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-982c5f7c-4a0e-40a1-a7ed-efad0038d8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:03.126247 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:03.179626 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5f7c-4a0e-40a1-a7ed-efad0038d8d5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:03.183369 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b98619-0070-4f65-b566-569cd3f85616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:03.183983 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98619-0070-4f65-b566-569cd3f85616 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:03.184268 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98619-0070-4f65-b566-569cd3f85616 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:03.184580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98619-0070-4f65-b566-569cd3f85616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:03.194637 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b98619-0070-4f65-b566-569cd3f85616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:03.196048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b98619-0070-4f65-b566-569cd3f85616 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:03.205483 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1257/2509] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:04.546116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25396f5-3201-47ca-9437-a250f9ef439f None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:04.563967 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:04.610230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25396f5-3201-47ca-9437-a250f9ef439f None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:04.614838 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:04.615469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:04.615753 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:04.616029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] PATH_INFO: `/v3/users/6a49fa4575fe4e17bc640f48b5e52f83` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:04.617161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a49fa4575fe4e17bc640f48b5e52f83)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:04.619078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:04.663921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a49fa4575fe4e17bc640f48b5e52f83'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:04.664601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a49fa4575fe4e17bc640f48b5e52f83'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:04.671404 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a49fa4575fe4e17bc640f48b5e52f83'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:04.672042 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a49fa4575fe4e17bc640f48b5e52f83'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:04.683809 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a49fa4575fe4e17bc640f48b5e52f83'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:04.696182 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1253/2510] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:04 2022] DELETE /identity/v3/users/6a49fa4575fe4e17bc640f48b5e52f83 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:04.700901 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb056c-9170-4a0f-9020-edbeeb8da22e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:04.701389 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb056c-9170-4a0f-9020-edbeeb8da22e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:04.701487 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb056c-9170-4a0f-9020-edbeeb8da22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:04.722593 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5ddb056c-9170-4a0f-9020-edbeeb8da22e None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:04.723781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5ddb056c-9170-4a0f-9020-edbeeb8da22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:04.781947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1258/2511] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:04.792369 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:04.793802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:04.851163 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fa49d-d2c3-468e-87be-d1058fb8d762 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:04.854794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341124a-8fea-4b65-b6b4-08da2e9a8ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:04.855400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341124a-8fea-4b65-b6b4-08da2e9a8ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:04.855684 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341124a-8fea-4b65-b6b4-08da2e9a8ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:04.855959 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341124a-8fea-4b65-b6b4-08da2e9a8ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:04.865267 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341124a-8fea-4b65-b6b4-08da2e9a8ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:04.866686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341124a-8fea-4b65-b6b4-08da2e9a8ea4 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:04.875891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1254/2512] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:05.139426 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb056c-9170-4a0f-9020-edbeeb8da22e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:05.140893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5ddb056c-9170-4a0f-9020-edbeeb8da22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:05.153292 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb056c-9170-4a0f-9020-edbeeb8da22e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:05.158618 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:05.159352 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:05.159692 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:05.160689 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] PATH_INFO: `/v3/projects/f5c27e7fd53a4d33ba28a4ef594334b5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:05.162057 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c27e7fd53a4d33ba28a4ef594334b5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:05.163940 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:05.212693 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c27e7fd53a4d33ba28a4ef594334b5', 'request_id': 'req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.218091 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c27e7fd53a4d33ba28a4ef594334b5', 'request_id': 'req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.224373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c27e7fd53a4d33ba28a4ef594334b5', 'request_id': 'req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.237180 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] The token cache is being invalidate because project f5c27e7fd53a4d33ba28a4ef594334b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:05.237468 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.238085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.239553 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1259/2513] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:05 2022] DELETE /identity/v3/projects/f5c27e7fd53a4d33ba28a4ef594334b5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:05.243714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341124a-8fea-4b65-b6b4-08da2e9a8ea4 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:05.253972 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341124a-8fea-4b65-b6b4-08da2e9a8ea4 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:05.286122 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:05.309491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:05.310047 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:05.310328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:05.310601 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] PATH_INFO: `/v3/users/6f2bccb67f354092b3f2a4f87dbd6b39` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:05.311697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2bccb67f354092b3f2a4f87dbd6b39)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:05.313628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:05.358603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2bccb67f354092b3f2a4f87dbd6b39'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.359248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2bccb67f354092b3f2a4f87dbd6b39'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.366917 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2bccb67f354092b3f2a4f87dbd6b39'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.367558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2bccb67f354092b3f2a4f87dbd6b39'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.380606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-bcb605b3-54ea-4808-a194-545fe87b36d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2bccb67f354092b3f2a4f87dbd6b39'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.393386 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1255/2514] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:05 2022] DELETE /identity/v3/users/6f2bccb67f354092b3f2a4f87dbd6b39 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:05.675006 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:05.676437 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:05.690547 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8617-5860-41df-af4b-bb74e3ac4cc4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:05.721401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:05.750382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:05.751021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:05.751899 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:05.752274 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] PATH_INFO: `/v3/projects/aefbc308fb9b4d3caa249488ece26c09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:05.753432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefbc308fb9b4d3caa249488ece26c09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:05.755326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:05.800105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefbc308fb9b4d3caa249488ece26c09', 'request_id': 'req-9fff8323-e82a-44e5-b88e-a5bbd86143eb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.805573 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefbc308fb9b4d3caa249488ece26c09', 'request_id': 'req-9fff8323-e82a-44e5-b88e-a5bbd86143eb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.811672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefbc308fb9b4d3caa249488ece26c09', 'request_id': 'req-9fff8323-e82a-44e5-b88e-a5bbd86143eb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.824218 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] The token cache is being invalidate because project aefbc308fb9b4d3caa249488ece26c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:05.824450 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.825105 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9fff8323-e82a-44e5-b88e-a5bbd86143eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:05.826571 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1260/2515] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:05 2022] DELETE /identity/v3/projects/aefbc308fb9b4d3caa249488ece26c09 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:05.832049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf5577-4fc8-45fb-8ed4-95c480bbb367 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:05.832546 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf5577-4fc8-45fb-8ed4-95c480bbb367 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:05.832655 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf5577-4fc8-45fb-8ed4-95c480bbb367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:05.853552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-76bf5577-4fc8-45fb-8ed4-95c480bbb367 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:05.854740 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-76bf5577-4fc8-45fb-8ed4-95c480bbb367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:05.915430 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1256/2516] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:05.925051 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf0a1e-df52-433a-8465-a86f35db580a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:05.925420 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf0a1e-df52-433a-8465-a86f35db580a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:05.925708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf0a1e-df52-433a-8465-a86f35db580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:05.945865 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aabf0a1e-df52-433a-8465-a86f35db580a None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:05.947076 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aabf0a1e-df52-433a-8465-a86f35db580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:05.955580 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1261/2517] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:05.959856 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf5577-4fc8-45fb-8ed4-95c480bbb367 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:05.969493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf5577-4fc8-45fb-8ed4-95c480bbb367 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:05.974490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3563ba-3ec6-44e1-9f24-444ca92c2598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:05.975083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3563ba-3ec6-44e1-9f24-444ca92c2598 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:05.975361 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3563ba-3ec6-44e1-9f24-444ca92c2598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:05.975630 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3563ba-3ec6-44e1-9f24-444ca92c2598 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:05.976272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3563ba-3ec6-44e1-9f24-444ca92c2598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:44:05.976605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3563ba-3ec6-44e1-9f24-444ca92c2598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:05.978202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3563ba-3ec6-44e1-9f24-444ca92c2598 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:05.989979 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1257/2518] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:44:05.994075 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf0a1e-df52-433a-8465-a86f35db580a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.003937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf0a1e-df52-433a-8465-a86f35db580a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.008632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21287f-5baa-4ae7-8d82-2da0907be58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.009223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21287f-5baa-4ae7-8d82-2da0907be58c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.009508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21287f-5baa-4ae7-8d82-2da0907be58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.009807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21287f-5baa-4ae7-8d82-2da0907be58c admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.010441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21287f-5baa-4ae7-8d82-2da0907be58c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.012351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21287f-5baa-4ae7-8d82-2da0907be58c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.044356 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1262/2519] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:44:05 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:06.044605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3563ba-3ec6-44e1-9f24-444ca92c2598 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.053886 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3563ba-3ec6-44e1-9f24-444ca92c2598 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.094650 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:06.111469 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5bfcb-7bd1-4db0-89ee-a4785ee6c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.112210 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5bfcb-7bd1-4db0-89ee-a4785ee6c360 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.112522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5bfcb-7bd1-4db0-89ee-a4785ee6c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.112802 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5bfcb-7bd1-4db0-89ee-a4785ee6c360 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.113432 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5bfcb-7bd1-4db0-89ee-a4785ee6c360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.115328 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5bfcb-7bd1-4db0-89ee-a4785ee6c360 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.136768 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1258/2520] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:44:06 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:06.140858 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21287f-5baa-4ae7-8d82-2da0907be58c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.151162 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21287f-5baa-4ae7-8d82-2da0907be58c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.155686 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fc32c-a523-4220-9969-fee4643b431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.156278 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fc32c-a523-4220-9969-fee4643b431c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.156596 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fc32c-a523-4220-9969-fee4643b431c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.156873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fc32c-a523-4220-9969-fee4643b431c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.157530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fc32c-a523-4220-9969-fee4643b431c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.159110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fc32c-a523-4220-9969-fee4643b431c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.168763 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1263/2521] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:06.172845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5bfcb-7bd1-4db0-89ee-a4785ee6c360 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.183425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5bfcb-7bd1-4db0-89ee-a4785ee6c360 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.187957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d3296-31c9-41ba-82f9-af15962da2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.188582 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d3296-31c9-41ba-82f9-af15962da2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.189411 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d3296-31c9-41ba-82f9-af15962da2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.189822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d3296-31c9-41ba-82f9-af15962da2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.190464 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d3296-31c9-41ba-82f9-af15962da2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.192123 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d3296-31c9-41ba-82f9-af15962da2a2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.202462 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1259/2522] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:06.206436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fc32c-a523-4220-9969-fee4643b431c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.216300 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fc32c-a523-4220-9969-fee4643b431c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.221210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b18df-cf5c-44ff-8c75-b377b1b43c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.221851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b18df-cf5c-44ff-8c75-b377b1b43c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.222135 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b18df-cf5c-44ff-8c75-b377b1b43c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.222413 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b18df-cf5c-44ff-8c75-b377b1b43c15 admin admin] PATH_INFO: `/v3/projects/a4f55f6d2d6a47bdadbaf3b76c5b8b88/users/c64160b7866f43589c060380fe7c993b/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.237350 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b18df-cf5c-44ff-8c75-b377b1b43c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4f55f6d2d6a47bdadbaf3b76c5b8b88, user_id=c64160b7866f43589c060380fe7c993b, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.239981 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b18df-cf5c-44ff-8c75-b377b1b43c15 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.253532 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1264/2523] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:06 2022] PUT /identity/v3/projects/a4f55f6d2d6a47bdadbaf3b76c5b8b88/users/c64160b7866f43589c060380fe7c993b/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:06.263794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e476e1-0aba-46b7-92cc-95ebcba2d2bf None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.264095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e476e1-0aba-46b7-92cc-95ebcba2d2bf None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.264365 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e476e1-0aba-46b7-92cc-95ebcba2d2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.292903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-f0e476e1-0aba-46b7-92cc-95ebcba2d2bf None None] MFA Rules not processed for user `c64160b7866f43589c060380fe7c993b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:06.294089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f0e476e1-0aba-46b7-92cc-95ebcba2d2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:06.358984 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1260/2524] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:06.363435 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b18df-cf5c-44ff-8c75-b377b1b43c15 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.420885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:06.425341 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b18df-cf5c-44ff-8c75-b377b1b43c15 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.431551 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6d04f-bc05-4c4c-bc66-0f9ef7f18570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.432345 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6d04f-bc05-4c4c-bc66-0f9ef7f18570 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.432845 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6d04f-bc05-4c4c-bc66-0f9ef7f18570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.433187 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6d04f-bc05-4c4c-bc66-0f9ef7f18570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.434017 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6d04f-bc05-4c4c-bc66-0f9ef7f18570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.435999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6d04f-bc05-4c4c-bc66-0f9ef7f18570 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.462885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1265/2525] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:44:06 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:06.467258 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e476e1-0aba-46b7-92cc-95ebcba2d2bf None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.478037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e476e1-0aba-46b7-92cc-95ebcba2d2bf None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.534775 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45d93b-a51a-480a-8f90-f189dab4657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.535378 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d93b-a51a-480a-8f90-f189dab4657e admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.535657 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d93b-a51a-480a-8f90-f189dab4657e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.535925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45d93b-a51a-480a-8f90-f189dab4657e admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.536591 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45d93b-a51a-480a-8f90-f189dab4657e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.538480 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45d93b-a51a-480a-8f90-f189dab4657e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.559527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1261/2526] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:44:06 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:06.563663 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6d04f-bc05-4c4c-bc66-0f9ef7f18570 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.574032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6d04f-bc05-4c4c-bc66-0f9ef7f18570 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.578590 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bfe20-f71e-4190-bf81-9ef6231b05af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.579181 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bfe20-f71e-4190-bf81-9ef6231b05af admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.579490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bfe20-f71e-4190-bf81-9ef6231b05af admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.579768 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bfe20-f71e-4190-bf81-9ef6231b05af admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.580407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bfe20-f71e-4190-bf81-9ef6231b05af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.582013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bfe20-f71e-4190-bf81-9ef6231b05af admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.596297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1266/2527] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:06.597352 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45d93b-a51a-480a-8f90-f189dab4657e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.607669 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45d93b-a51a-480a-8f90-f189dab4657e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.613497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d767ad-8e8f-4ed5-a2ec-f7cfa4c7ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.614078 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d767ad-8e8f-4ed5-a2ec-f7cfa4c7ddfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.614359 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d767ad-8e8f-4ed5-a2ec-f7cfa4c7ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.614633 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d767ad-8e8f-4ed5-a2ec-f7cfa4c7ddfc admin admin] PATH_INFO: `/v3/projects/c02ee446bfb94408a469d91eb5476ff5/users/aff7a6240c614bf3ab8ff4d4b667348d/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.629628 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d767ad-8e8f-4ed5-a2ec-f7cfa4c7ddfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02ee446bfb94408a469d91eb5476ff5, user_id=aff7a6240c614bf3ab8ff4d4b667348d, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.632302 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d767ad-8e8f-4ed5-a2ec-f7cfa4c7ddfc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.645859 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1262/2528] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:06 2022] PUT /identity/v3/projects/c02ee446bfb94408a469d91eb5476ff5/users/aff7a6240c614bf3ab8ff4d4b667348d/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:06.649749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bfe20-f71e-4190-bf81-9ef6231b05af admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.660169 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bfe20-f71e-4190-bf81-9ef6231b05af admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.715416 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269ae12-eb03-4097-8df6-a278486bcad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.716018 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269ae12-eb03-4097-8df6-a278486bcad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.716297 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269ae12-eb03-4097-8df6-a278486bcad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.716605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269ae12-eb03-4097-8df6-a278486bcad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.717235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269ae12-eb03-4097-8df6-a278486bcad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.718803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269ae12-eb03-4097-8df6-a278486bcad8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.729410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1267/2529] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:44:06.733771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d767ad-8e8f-4ed5-a2ec-f7cfa4c7ddfc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.745383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d767ad-8e8f-4ed5-a2ec-f7cfa4c7ddfc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.750005 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb024d-9222-4725-954b-7b7bbcf8dd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.750654 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb024d-9222-4725-954b-7b7bbcf8dd86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.750973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb024d-9222-4725-954b-7b7bbcf8dd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.751395 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb024d-9222-4725-954b-7b7bbcf8dd86 admin admin] PATH_INFO: `/v3/projects/c02ee446bfb94408a469d91eb5476ff5/users/aff7a6240c614bf3ab8ff4d4b667348d/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.753815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb024d-9222-4725-954b-7b7bbcf8dd86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02ee446bfb94408a469d91eb5476ff5, user_id=aff7a6240c614bf3ab8ff4d4b667348d, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.756511 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb024d-9222-4725-954b-7b7bbcf8dd86 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.766563 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1263/2530] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:06 2022] PUT /identity/v3/projects/c02ee446bfb94408a469d91eb5476ff5/users/aff7a6240c614bf3ab8ff4d4b667348d/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:06.778202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c8e50-dabf-46b8-885a-18b46f495ceb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.778496 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c8e50-dabf-46b8-885a-18b46f495ceb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.778774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c8e50-dabf-46b8-885a-18b46f495ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.807050 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6a7c8e50-dabf-46b8-885a-18b46f495ceb None None] MFA Rules not processed for user `aff7a6240c614bf3ab8ff4d4b667348d`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:06.808257 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6a7c8e50-dabf-46b8-885a-18b46f495ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:06.876821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1268/2531] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:06.887339 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb024d-9222-4725-954b-7b7bbcf8dd86 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:06.889169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-31bb024d-9222-4725-954b-7b7bbcf8dd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:06.896241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:06.948605 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb024d-9222-4725-954b-7b7bbcf8dd86 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:06.952215 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb17d1-464b-431a-9dea-3ce37017c710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:06.952840 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb17d1-464b-431a-9dea-3ce37017c710 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:06.953116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb17d1-464b-431a-9dea-3ce37017c710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:06.953383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb17d1-464b-431a-9dea-3ce37017c710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:06.962602 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb17d1-464b-431a-9dea-3ce37017c710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:06.964021 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb17d1-464b-431a-9dea-3ce37017c710 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:06.973341 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1264/2532] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:07.076745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c8e50-dabf-46b8-885a-18b46f495ceb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:07.086517 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c8e50-dabf-46b8-885a-18b46f495ceb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:07.090204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43adcc2-d87a-4a62-92e8-a88fbb5dba47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:07.090794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43adcc2-d87a-4a62-92e8-a88fbb5dba47 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:07.091098 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43adcc2-d87a-4a62-92e8-a88fbb5dba47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:07.091387 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43adcc2-d87a-4a62-92e8-a88fbb5dba47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:07.138843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:07.148130 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43adcc2-d87a-4a62-92e8-a88fbb5dba47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:07.149600 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43adcc2-d87a-4a62-92e8-a88fbb5dba47 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:07.158967 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1269/2533] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:09.744614 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb17d1-464b-431a-9dea-3ce37017c710 service cinder] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:09.808565 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb17d1-464b-431a-9dea-3ce37017c710 service cinder] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:09.813201 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:09.813785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:09.814095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:09.814448 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] PATH_INFO: `/v3/users/c64160b7866f43589c060380fe7c993b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:09.815572 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64160b7866f43589c060380fe7c993b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:09.817536 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:09.869673 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64160b7866f43589c060380fe7c993b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:09.870453 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64160b7866f43589c060380fe7c993b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:09.878494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64160b7866f43589c060380fe7c993b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:09.879171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64160b7866f43589c060380fe7c993b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:09.891040 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64160b7866f43589c060380fe7c993b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:09.904497 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1265/2534] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:09 2022] DELETE /identity/v3/users/c64160b7866f43589c060380fe7c993b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:09.916632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d79ac-2ef8-4f63-a7f9-bc51caf00b6d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:09.916632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d79ac-2ef8-4f63-a7f9-bc51caf00b6d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:09.916632 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d79ac-2ef8-4f63-a7f9-bc51caf00b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:09.929950 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a07d79ac-2ef8-4f63-a7f9-bc51caf00b6d None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:09.931371 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a07d79ac-2ef8-4f63-a7f9-bc51caf00b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:09.990326 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1270/2535] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:10.000354 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:10.002105 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:10.033431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:10.067580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40088395-fc6f-4baf-9316-47c91ffd89e5 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:10.071249 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a32c31-9f68-4851-a935-e3669234e087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:10.071852 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32c31-9f68-4851-a935-e3669234e087 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:10.072132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32c31-9f68-4851-a935-e3669234e087 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:10.072403 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32c31-9f68-4851-a935-e3669234e087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:10.082580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a32c31-9f68-4851-a935-e3669234e087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:10.084024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a32c31-9f68-4851-a935-e3669234e087 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:10.093319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1266/2536] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:10.383267 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d79ac-2ef8-4f63-a7f9-bc51caf00b6d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:10.384726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a07d79ac-2ef8-4f63-a7f9-bc51caf00b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:10.397896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d79ac-2ef8-4f63-a7f9-bc51caf00b6d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:10.402524 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:10.403158 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:10.403441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:10.403713 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] PATH_INFO: `/v3/projects/a4f55f6d2d6a47bdadbaf3b76c5b8b88` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:10.404907 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4f55f6d2d6a47bdadbaf3b76c5b8b88)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:10.406783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:10.453514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4f55f6d2d6a47bdadbaf3b76c5b8b88', 'request_id': 'req-c4478ce1-af54-41e5-94d0-31443101f165'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:10.459817 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4f55f6d2d6a47bdadbaf3b76c5b8b88', 'request_id': 'req-c4478ce1-af54-41e5-94d0-31443101f165'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:10.466284 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4f55f6d2d6a47bdadbaf3b76c5b8b88', 'request_id': 'req-c4478ce1-af54-41e5-94d0-31443101f165'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:10.478923 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] The token cache is being invalidate because project a4f55f6d2d6a47bdadbaf3b76c5b8b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:10.479213 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:10.479836 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:10.481415 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1271/2537] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:10 2022] DELETE /identity/v3/projects/a4f55f6d2d6a47bdadbaf3b76c5b8b88 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:10.485890 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a32c31-9f68-4851-a935-e3669234e087 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:10.495316 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a32c31-9f68-4851-a935-e3669234e087 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:10.553075 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:10.553705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:10.553988 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:10.554261 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] PATH_INFO: `/v3/users/aff7a6240c614bf3ab8ff4d4b667348d` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:10.555406 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff7a6240c614bf3ab8ff4d4b667348d)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:10.557354 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:10.601834 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff7a6240c614bf3ab8ff4d4b667348d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:10.602504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff7a6240c614bf3ab8ff4d4b667348d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:10.609822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff7a6240c614bf3ab8ff4d4b667348d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:10.611085 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff7a6240c614bf3ab8ff4d4b667348d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:10.622973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-eb5e97b5-7300-4429-b1d7-ee1885635382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff7a6240c614bf3ab8ff4d4b667348d'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:10.635107 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1267/2538] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:10 2022] DELETE /identity/v3/users/aff7a6240c614bf3ab8ff4d4b667348d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:10.904627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:10.906211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:10.924725 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4478ce1-af54-41e5-94d0-31443101f165 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:10.980110 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:10.980784 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:10.981066 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:10.981340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] PATH_INFO: `/v3/projects/c02ee446bfb94408a469d91eb5476ff5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:10.982507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c02ee446bfb94408a469d91eb5476ff5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:10.984627 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.001111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:11.030215 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c02ee446bfb94408a469d91eb5476ff5', 'request_id': 'req-dac06d12-be62-4ff6-ab21-aa0123ea9081'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:11.036362 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c02ee446bfb94408a469d91eb5476ff5', 'request_id': 'req-dac06d12-be62-4ff6-ab21-aa0123ea9081'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:11.042759 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c02ee446bfb94408a469d91eb5476ff5', 'request_id': 'req-dac06d12-be62-4ff6-ab21-aa0123ea9081'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:11.057769 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] The token cache is being invalidate because project c02ee446bfb94408a469d91eb5476ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:11.058065 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:11.058688 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dac06d12-be62-4ff6-ab21-aa0123ea9081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:11.060202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1272/2539] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:10 2022] DELETE /identity/v3/projects/c02ee446bfb94408a469d91eb5476ff5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:11.065652 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b868cfd-a4c2-49ec-b51a-28f1d1744442 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.066129 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b868cfd-a4c2-49ec-b51a-28f1d1744442 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.066230 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b868cfd-a4c2-49ec-b51a-28f1d1744442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.087030 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-7b868cfd-a4c2-49ec-b51a-28f1d1744442 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:11.088268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-7b868cfd-a4c2-49ec-b51a-28f1d1744442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:11.134446 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:11.151345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1268/2540] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:44:11.159947 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34de4a-247e-4c13-a2e0-24c5f3a96b64 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.160241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34de4a-247e-4c13-a2e0-24c5f3a96b64 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.160560 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34de4a-247e-4c13-a2e0-24c5f3a96b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.180791 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aa34de4a-247e-4c13-a2e0-24c5f3a96b64 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:11.182003 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa34de4a-247e-4c13-a2e0-24c5f3a96b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:11.190113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1273/2541] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:11.194250 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b868cfd-a4c2-49ec-b51a-28f1d1744442 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.203824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b868cfd-a4c2-49ec-b51a-28f1d1744442 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.208824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68362d00-35cd-460b-8595-22ca5a68cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.209419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68362d00-35cd-460b-8595-22ca5a68cadc admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.209701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68362d00-35cd-460b-8595-22ca5a68cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.210004 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68362d00-35cd-460b-8595-22ca5a68cadc admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.210653 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68362d00-35cd-460b-8595-22ca5a68cadc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:44:11.210957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68362d00-35cd-460b-8595-22ca5a68cadc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.212568 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68362d00-35cd-460b-8595-22ca5a68cadc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.225848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1269/2542] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:44:11.229346 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34de4a-247e-4c13-a2e0-24c5f3a96b64 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.239258 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34de4a-247e-4c13-a2e0-24c5f3a96b64 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.243757 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd906cf-8981-4908-b602-aee4e0a61b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.244340 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd906cf-8981-4908-b602-aee4e0a61b49 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.244649 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd906cf-8981-4908-b602-aee4e0a61b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.244925 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd906cf-8981-4908-b602-aee4e0a61b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.245551 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd906cf-8981-4908-b602-aee4e0a61b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.247401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd906cf-8981-4908-b602-aee4e0a61b49 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.273047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1274/2543] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:44:11 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:44:11.277144 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68362d00-35cd-460b-8595-22ca5a68cadc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.287329 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68362d00-35cd-460b-8595-22ca5a68cadc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.346261 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc840a-e2c1-491f-929f-72d75ffddb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.346871 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc840a-e2c1-491f-929f-72d75ffddb08 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.347151 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc840a-e2c1-491f-929f-72d75ffddb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.347705 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc840a-e2c1-491f-929f-72d75ffddb08 admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.348069 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc840a-e2c1-491f-929f-72d75ffddb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.350001 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc840a-e2c1-491f-929f-72d75ffddb08 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.371165 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1270/2544] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:44:11 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:11.375370 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd906cf-8981-4908-b602-aee4e0a61b49 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.385634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd906cf-8981-4908-b602-aee4e0a61b49 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.390242 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bbda6-3cd8-4610-9a78-1db7ee4e9e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.390840 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bbda6-3cd8-4610-9a78-1db7ee4e9e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.391123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bbda6-3cd8-4610-9a78-1db7ee4e9e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.391396 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bbda6-3cd8-4610-9a78-1db7ee4e9e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.392797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bbda6-3cd8-4610-9a78-1db7ee4e9e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.394190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bbda6-3cd8-4610-9a78-1db7ee4e9e68 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.404408 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1275/2545] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:11.409624 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc840a-e2c1-491f-929f-72d75ffddb08 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.420033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc840a-e2c1-491f-929f-72d75ffddb08 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.431451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9bbab-2579-43c3-ba7b-e572ff1aaeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.432193 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9bbab-2579-43c3-ba7b-e572ff1aaeca admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.432590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9bbab-2579-43c3-ba7b-e572ff1aaeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.432983 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9bbab-2579-43c3-ba7b-e572ff1aaeca admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.433643 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9bbab-2579-43c3-ba7b-e572ff1aaeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.435466 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9bbab-2579-43c3-ba7b-e572ff1aaeca admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.447689 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1271/2546] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:11.451878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bbda6-3cd8-4610-9a78-1db7ee4e9e68 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.462353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bbda6-3cd8-4610-9a78-1db7ee4e9e68 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.467687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184e65e-a8e0-4e98-bfe6-b1af39447168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.468454 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184e65e-a8e0-4e98-bfe6-b1af39447168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.468764 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184e65e-a8e0-4e98-bfe6-b1af39447168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.469040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184e65e-a8e0-4e98-bfe6-b1af39447168 admin admin] PATH_INFO: `/v3/projects/098b328195104b83823045699bddd63b/users/8b92040cfaad4a9ca25e1188d6455ec1/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.486367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184e65e-a8e0-4e98-bfe6-b1af39447168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098b328195104b83823045699bddd63b, user_id=8b92040cfaad4a9ca25e1188d6455ec1, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.489059 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184e65e-a8e0-4e98-bfe6-b1af39447168 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.503401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1276/2547] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:11 2022] PUT /identity/v3/projects/098b328195104b83823045699bddd63b/users/8b92040cfaad4a9ca25e1188d6455ec1/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:11.513794 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b619-1869-486e-9158-e7a885d40e47 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.514083 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b619-1869-486e-9158-e7a885d40e47 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.514354 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b619-1869-486e-9158-e7a885d40e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.545501 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-d523b619-1869-486e-9158-e7a885d40e47 None None] MFA Rules not processed for user `8b92040cfaad4a9ca25e1188d6455ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:11.546759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-d523b619-1869-486e-9158-e7a885d40e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:11.615924 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1272/2548] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:11.620680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184e65e-a8e0-4e98-bfe6-b1af39447168 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.686174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184e65e-a8e0-4e98-bfe6-b1af39447168 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.691472 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c216fce-934c-49d3-b8ac-93da002437fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.692069 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c216fce-934c-49d3-b8ac-93da002437fa admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.692353 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c216fce-934c-49d3-b8ac-93da002437fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.692657 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c216fce-934c-49d3-b8ac-93da002437fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.693289 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c216fce-934c-49d3-b8ac-93da002437fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.695176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c216fce-934c-49d3-b8ac-93da002437fa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.721787 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1277/2549] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:44:11 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:44:11.725935 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b619-1869-486e-9158-e7a885d40e47 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.737028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b619-1869-486e-9158-e7a885d40e47 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.779427 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:11.794822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216156c5-a7e1-4178-bf1f-17bb68bb78ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.795445 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216156c5-a7e1-4178-bf1f-17bb68bb78ae admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.795723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216156c5-a7e1-4178-bf1f-17bb68bb78ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.795998 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216156c5-a7e1-4178-bf1f-17bb68bb78ae admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.796666 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216156c5-a7e1-4178-bf1f-17bb68bb78ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.798801 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216156c5-a7e1-4178-bf1f-17bb68bb78ae admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.819145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1273/2550] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:44:11 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:44:11.823217 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c216fce-934c-49d3-b8ac-93da002437fa admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.834173 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c216fce-934c-49d3-b8ac-93da002437fa admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.838973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3c281-7670-460d-a135-5e0abb275e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.839568 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3c281-7670-460d-a135-5e0abb275e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.839860 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3c281-7670-460d-a135-5e0abb275e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.840140 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3c281-7670-460d-a135-5e0abb275e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.840821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3c281-7670-460d-a135-5e0abb275e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.842401 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3c281-7670-460d-a135-5e0abb275e3c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.853613 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1278/2551] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:11.858155 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216156c5-a7e1-4178-bf1f-17bb68bb78ae admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.868952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216156c5-a7e1-4178-bf1f-17bb68bb78ae admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.873588 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454a24e-80a1-43e2-8dfb-3d541a44e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.874240 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454a24e-80a1-43e2-8dfb-3d541a44e53b admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.874521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454a24e-80a1-43e2-8dfb-3d541a44e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.874799 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454a24e-80a1-43e2-8dfb-3d541a44e53b admin admin] PATH_INFO: `/v3/projects/48cf4a9bb37c433b944298ed49dc3eb4/users/d7511718fd0548d2970b86b31708ed42/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.889376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454a24e-80a1-43e2-8dfb-3d541a44e53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cf4a9bb37c433b944298ed49dc3eb4, user_id=d7511718fd0548d2970b86b31708ed42, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.892026 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454a24e-80a1-43e2-8dfb-3d541a44e53b admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.905145 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1274/2552] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:11 2022] PUT /identity/v3/projects/48cf4a9bb37c433b944298ed49dc3eb4/users/d7511718fd0548d2970b86b31708ed42/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:11.909666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3c281-7670-460d-a135-5e0abb275e3c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:11.919536 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3c281-7670-460d-a135-5e0abb275e3c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:11.931395 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:11.976777 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78fc40-1cb4-4a73-88f8-c71a40b69de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:11.977370 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78fc40-1cb4-4a73-88f8-c71a40b69de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:11.977650 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78fc40-1cb4-4a73-88f8-c71a40b69de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:11.977924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78fc40-1cb4-4a73-88f8-c71a40b69de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:11.978550 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78fc40-1cb4-4a73-88f8-c71a40b69de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:11.980111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78fc40-1cb4-4a73-88f8-c71a40b69de5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:11.990304 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1279/2553] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:11.994494 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454a24e-80a1-43e2-8dfb-3d541a44e53b admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:12.004742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454a24e-80a1-43e2-8dfb-3d541a44e53b admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:12.009307 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94852e-0d2c-420c-8776-0846d5be0fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:12.009949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94852e-0d2c-420c-8776-0846d5be0fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:12.010227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94852e-0d2c-420c-8776-0846d5be0fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:12.010499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94852e-0d2c-420c-8776-0846d5be0fc0 admin admin] PATH_INFO: `/v3/projects/48cf4a9bb37c433b944298ed49dc3eb4/users/d7511718fd0548d2970b86b31708ed42/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:12.012382 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94852e-0d2c-420c-8776-0846d5be0fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cf4a9bb37c433b944298ed49dc3eb4, user_id=d7511718fd0548d2970b86b31708ed42, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:12.015009 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94852e-0d2c-420c-8776-0846d5be0fc0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:12.025081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1275/2554] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:11 2022] PUT /identity/v3/projects/48cf4a9bb37c433b944298ed49dc3eb4/users/d7511718fd0548d2970b86b31708ed42/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:12.091216 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37db535-0c4d-4114-8d87-4f68408ce734 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:12.091498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37db535-0c4d-4114-8d87-4f68408ce734 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:12.091774 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37db535-0c4d-4114-8d87-4f68408ce734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:12.119757 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b37db535-0c4d-4114-8d87-4f68408ce734 None None] MFA Rules not processed for user `d7511718fd0548d2970b86b31708ed42`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:12.121037 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b37db535-0c4d-4114-8d87-4f68408ce734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:12.186629 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1280/2555] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:12.197318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94852e-0d2c-420c-8776-0846d5be0fc0 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:12.198985 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ad94852e-0d2c-420c-8776-0846d5be0fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:12.256110 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94852e-0d2c-420c-8776-0846d5be0fc0 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:12.259736 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656eb4e9-0ce4-4e2d-bda6-9c88cdecea68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:12.260330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eb4e9-0ce4-4e2d-bda6-9c88cdecea68 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:12.260640 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eb4e9-0ce4-4e2d-bda6-9c88cdecea68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:12.260918 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eb4e9-0ce4-4e2d-bda6-9c88cdecea68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:12.270197 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656eb4e9-0ce4-4e2d-bda6-9c88cdecea68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:12.271617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656eb4e9-0ce4-4e2d-bda6-9c88cdecea68 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:12.280759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1276/2556] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:12.853643 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37db535-0c4d-4114-8d87-4f68408ce734 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:12.918016 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37db535-0c4d-4114-8d87-4f68408ce734 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:12.922526 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:12.923202 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:12.923480 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:12.923756 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] PATH_INFO: `/v3/users/8b92040cfaad4a9ca25e1188d6455ec1` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:12.924918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b92040cfaad4a9ca25e1188d6455ec1)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:12.926843 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:12.966467 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:12.973904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b92040cfaad4a9ca25e1188d6455ec1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:12.974558 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b92040cfaad4a9ca25e1188d6455ec1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:12.981307 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b92040cfaad4a9ca25e1188d6455ec1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:12.989275 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b92040cfaad4a9ca25e1188d6455ec1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:12.989980 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b92040cfaad4a9ca25e1188d6455ec1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.007208 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1281/2557] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:12 2022] DELETE /identity/v3/users/8b92040cfaad4a9ca25e1188d6455ec1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:13.011878 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed41f0-2fa5-4f6c-b0f0-bafb9ae1a8cd None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:13.012164 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed41f0-2fa5-4f6c-b0f0-bafb9ae1a8cd None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:13.012441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed41f0-2fa5-4f6c-b0f0-bafb9ae1a8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:13.033490 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-9fed41f0-2fa5-4f6c-b0f0-bafb9ae1a8cd None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:13.034721 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9fed41f0-2fa5-4f6c-b0f0-bafb9ae1a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:13.093419 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1277/2558] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:13.103829 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:13.105220 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:13.161040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a62c43-2915-4074-8215-41ef173fbfa4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:13.164735 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e334eec-4a9f-4017-b3f0-4734aa2166f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:13.165327 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e334eec-4a9f-4017-b3f0-4734aa2166f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:13.165604 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e334eec-4a9f-4017-b3f0-4734aa2166f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:13.165874 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e334eec-4a9f-4017-b3f0-4734aa2166f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:13.174732 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e334eec-4a9f-4017-b3f0-4734aa2166f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:13.176123 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e334eec-4a9f-4017-b3f0-4734aa2166f1 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:13.185259 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1282/2559] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:44:13.447420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed41f0-2fa5-4f6c-b0f0-bafb9ae1a8cd None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:13.449358 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-9fed41f0-2fa5-4f6c-b0f0-bafb9ae1a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:13.463552 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed41f0-2fa5-4f6c-b0f0-bafb9ae1a8cd None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:13.468883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:13.469491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:13.469771 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:13.470045 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] PATH_INFO: `/v3/projects/098b328195104b83823045699bddd63b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:13.471228 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] RBAC: Authorizing `identity:delete_project(project_id=098b328195104b83823045699bddd63b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:13.473266 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:13.510636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:13.522420 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098b328195104b83823045699bddd63b', 'request_id': 'req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.529558 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098b328195104b83823045699bddd63b', 'request_id': 'req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.535942 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098b328195104b83823045699bddd63b', 'request_id': 'req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.547134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] The token cache is being invalidate because project 098b328195104b83823045699bddd63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:13.547425 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.548235 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.550393 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1278/2560] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:13 2022] DELETE /identity/v3/projects/098b328195104b83823045699bddd63b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:13.554407 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e334eec-4a9f-4017-b3f0-4734aa2166f1 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:13.563866 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e334eec-4a9f-4017-b3f0-4734aa2166f1 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:13.622569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:13.623198 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:13.623481 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:13.623812 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] PATH_INFO: `/v3/users/d7511718fd0548d2970b86b31708ed42` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:13.624913 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7511718fd0548d2970b86b31708ed42)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:13.627898 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:13.675150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7511718fd0548d2970b86b31708ed42'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.675822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7511718fd0548d2970b86b31708ed42'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.682779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7511718fd0548d2970b86b31708ed42'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.686325 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:13.691241 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7511718fd0548d2970b86b31708ed42'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.694182 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f4cc23f9-b408-4405-b2de-e1ec003be1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7511718fd0548d2970b86b31708ed42'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:13.712529 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1283/2561] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:13 2022] DELETE /identity/v3/users/d7511718fd0548d2970b86b31708ed42 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:14.007704 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:14.009819 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:14.023829 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28d031-2668-4ad3-b2ea-ee90e6a5065f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:14.082269 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:14.082904 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.083183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.083452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] PATH_INFO: `/v3/projects/48cf4a9bb37c433b944298ed49dc3eb4` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.084589 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cf4a9bb37c433b944298ed49dc3eb4)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:14.086598 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:14.133216 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cf4a9bb37c433b944298ed49dc3eb4', 'request_id': 'req-e1ffa303-795f-454f-9d55-53b4fbc46dd0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:14.140241 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cf4a9bb37c433b944298ed49dc3eb4', 'request_id': 'req-e1ffa303-795f-454f-9d55-53b4fbc46dd0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:14.146108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cf4a9bb37c433b944298ed49dc3eb4', 'request_id': 'req-e1ffa303-795f-454f-9d55-53b4fbc46dd0'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:14.157374 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] The token cache is being invalidate because project 48cf4a9bb37c433b944298ed49dc3eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:14.157663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:14.158915 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-e1ffa303-795f-454f-9d55-53b4fbc46dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:14.160376 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1279/2562] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:14 2022] DELETE /identity/v3/projects/48cf4a9bb37c433b944298ed49dc3eb4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:14.165224 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3517-2fc7-4f17-a946-b0097fb565bf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.165684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3517-2fc7-4f17-a946-b0097fb565bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.165783 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3517-2fc7-4f17-a946-b0097fb565bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.186591 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ef3c3517-2fc7-4f17-a946-b0097fb565bf None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:14.187800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef3c3517-2fc7-4f17-a946-b0097fb565bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:14.246377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1284/2563] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:14.254046 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197a7d8-0a9a-4d7d-8749-d2b765534602 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.254332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197a7d8-0a9a-4d7d-8749-d2b765534602 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.254606 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197a7d8-0a9a-4d7d-8749-d2b765534602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.274441 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-2197a7d8-0a9a-4d7d-8749-d2b765534602 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:14.275623 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-2197a7d8-0a9a-4d7d-8749-d2b765534602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:14.284095 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1280/2564] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:14.288397 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c3517-2fc7-4f17-a946-b0097fb565bf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:14.298029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c3517-2fc7-4f17-a946-b0097fb565bf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:14.303132 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a86fb5-5536-4190-9e50-f6f6a7942a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:14.303726 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a86fb5-5536-4190-9e50-f6f6a7942a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.304011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a86fb5-5536-4190-9e50-f6f6a7942a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.304290 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a86fb5-5536-4190-9e50-f6f6a7942a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.304972 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a86fb5-5536-4190-9e50-f6f6a7942a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:44:14.305281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a86fb5-5536-4190-9e50-f6f6a7942a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:14.306851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a86fb5-5536-4190-9e50-f6f6a7942a8b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:14.318660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1285/2565] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:44:14.322845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197a7d8-0a9a-4d7d-8749-d2b765534602 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:14.332335 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197a7d8-0a9a-4d7d-8749-d2b765534602 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:14.336913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b2108-162c-4fdc-a7b9-f487f5c715a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:14.337500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b2108-162c-4fdc-a7b9-f487f5c715a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.337779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b2108-162c-4fdc-a7b9-f487f5c715a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.338051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b2108-162c-4fdc-a7b9-f487f5c715a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.338701 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b2108-162c-4fdc-a7b9-f487f5c715a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:14.340617 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b2108-162c-4fdc-a7b9-f487f5c715a3 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:14.369823 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1281/2566] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:44:14 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:14.371536 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a86fb5-5536-4190-9e50-f6f6a7942a8b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:14.381488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a86fb5-5536-4190-9e50-f6f6a7942a8b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:14.440443 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b803a8-c9dc-42ca-b727-f030c053869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:14.441116 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b803a8-c9dc-42ca-b727-f030c053869a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.441439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b803a8-c9dc-42ca-b727-f030c053869a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.441751 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b803a8-c9dc-42ca-b727-f030c053869a admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.442508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b803a8-c9dc-42ca-b727-f030c053869a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:14.444644 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b803a8-c9dc-42ca-b727-f030c053869a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:14.465656 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1286/2567] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:44:14 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:14.469807 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b2108-162c-4fdc-a7b9-f487f5c715a3 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:14.481227 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b2108-162c-4fdc-a7b9-f487f5c715a3 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:14.486176 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10937de-990f-4cd0-9f94-bec4add17990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:14.486893 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10937de-990f-4cd0-9f94-bec4add17990 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.487177 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10937de-990f-4cd0-9f94-bec4add17990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.487454 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10937de-990f-4cd0-9f94-bec4add17990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.488108 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10937de-990f-4cd0-9f94-bec4add17990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:14.489760 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10937de-990f-4cd0-9f94-bec4add17990 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:14.499452 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1282/2568] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:14.503377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b803a8-c9dc-42ca-b727-f030c053869a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:14.513386 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b803a8-c9dc-42ca-b727-f030c053869a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:14.518447 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1ac4a-f36e-4b66-b644-d83546252cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:14.519026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1ac4a-f36e-4b66-b644-d83546252cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.519306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1ac4a-f36e-4b66-b644-d83546252cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.519577 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1ac4a-f36e-4b66-b644-d83546252cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.520210 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1ac4a-f36e-4b66-b644-d83546252cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:14.521839 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1ac4a-f36e-4b66-b644-d83546252cd4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:14.532251 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1287/2569] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:14.536894 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10937de-990f-4cd0-9f94-bec4add17990 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:14.546765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10937de-990f-4cd0-9f94-bec4add17990 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:14.551413 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72653f1-ea69-43a8-b9dd-dee9987a155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:14.552056 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72653f1-ea69-43a8-b9dd-dee9987a155f admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.552334 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72653f1-ea69-43a8-b9dd-dee9987a155f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.552636 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72653f1-ea69-43a8-b9dd-dee9987a155f admin admin] PATH_INFO: `/v3/projects/ac94f8af2e0a414899e678b6c9c1988b/users/b6f43f110c024ceba3aa83227719bd9c/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.563402 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:14.568116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72653f1-ea69-43a8-b9dd-dee9987a155f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac94f8af2e0a414899e678b6c9c1988b, user_id=b6f43f110c024ceba3aa83227719bd9c, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:14.571051 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72653f1-ea69-43a8-b9dd-dee9987a155f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:14.585065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1283/2570] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:14 2022] PUT /identity/v3/projects/ac94f8af2e0a414899e678b6c9c1988b/users/b6f43f110c024ceba3aa83227719bd9c/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:14.595432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcafa6-4482-4083-8309-719fe54442ae None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.596232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcafa6-4482-4083-8309-719fe54442ae None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.596633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcafa6-4482-4083-8309-719fe54442ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.626528 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1fdcafa6-4482-4083-8309-719fe54442ae None None] MFA Rules not processed for user `b6f43f110c024ceba3aa83227719bd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:14.627745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1fdcafa6-4482-4083-8309-719fe54442ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:14.659539 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:14.693634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1288/2571] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:14.704342 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72653f1-ea69-43a8-b9dd-dee9987a155f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:14.706789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-b72653f1-ea69-43a8-b9dd-dee9987a155f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:14.762545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72653f1-ea69-43a8-b9dd-dee9987a155f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:14.766288 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23cece-f311-40d7-ad13-28c5294a8d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:14.766889 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23cece-f311-40d7-ad13-28c5294a8d25 service cinder] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.767173 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23cece-f311-40d7-ad13-28c5294a8d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.768024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23cece-f311-40d7-ad13-28c5294a8d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.776509 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23cece-f311-40d7-ad13-28c5294a8d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:14.778049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23cece-f311-40d7-ad13-28c5294a8d25 service cinder] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:14.786903 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1284/2572] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:14.861036 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcafa6-4482-4083-8309-719fe54442ae None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:14.862405 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1fdcafa6-4482-4083-8309-719fe54442ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:14.928149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcafa6-4482-4083-8309-719fe54442ae None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:14.933175 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:14.933938 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:14.934221 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:14.934607 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] PATH_INFO: `/v3/users/9c5074a286b84337929be565bcd76bb6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:14.936113 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c5074a286b84337929be565bcd76bb6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:14.937750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:14.984745 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c5074a286b84337929be565bcd76bb6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:14.985410 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c5074a286b84337929be565bcd76bb6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:14.992588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c5074a286b84337929be565bcd76bb6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:15.000283 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c5074a286b84337929be565bcd76bb6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:15.000943 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c5074a286b84337929be565bcd76bb6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:15.021634 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1289/2573] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:14 2022] DELETE /identity/v3/users/9c5074a286b84337929be565bcd76bb6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:15.026387 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777def-6104-4123-a092-ee9479865652 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.026658 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777def-6104-4123-a092-ee9479865652 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.027022 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777def-6104-4123-a092-ee9479865652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:15.047663 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-5d777def-6104-4123-a092-ee9479865652 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:15.048359 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5d777def-6104-4123-a092-ee9479865652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:15.116503 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1285/2574] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:15.125133 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:15.128152 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:15.188043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2b9bc-4881-4ef1-8464-770cd422fea4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:15.193851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea418fba-5c68-4c2a-bc08-797e8b7e7d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:15.194452 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea418fba-5c68-4c2a-bc08-797e8b7e7d9a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.194729 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea418fba-5c68-4c2a-bc08-797e8b7e7d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.194999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea418fba-5c68-4c2a-bc08-797e8b7e7d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:15.201885 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:15.204492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea418fba-5c68-4c2a-bc08-797e8b7e7d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:15.206223 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea418fba-5c68-4c2a-bc08-797e8b7e7d9a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:15.216150 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1290/2575] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:15.481546 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d777def-6104-4123-a092-ee9479865652 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:15.483239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-5d777def-6104-4123-a092-ee9479865652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:15.496231 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d777def-6104-4123-a092-ee9479865652 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:15.500891 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:15.502065 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.502450 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.502728 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] PATH_INFO: `/v3/projects/076b034e943c45489001ce7ffba634d0` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:15.503884 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=076b034e943c45489001ce7ffba634d0)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:15.505816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:15.552919 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076b034e943c45489001ce7ffba634d0', 'request_id': 'req-1f83096c-08cc-4c3c-83b7-b785e9d224cc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:15.560248 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076b034e943c45489001ce7ffba634d0', 'request_id': 'req-1f83096c-08cc-4c3c-83b7-b785e9d224cc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:15.566913 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076b034e943c45489001ce7ffba634d0', 'request_id': 'req-1f83096c-08cc-4c3c-83b7-b785e9d224cc'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:15.577969 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] The token cache is being invalidate because project 076b034e943c45489001ce7ffba634d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:15.578259 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:15.578887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-1f83096c-08cc-4c3c-83b7-b785e9d224cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:15.581036 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1286/2576] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:15 2022] DELETE /identity/v3/projects/076b034e943c45489001ce7ffba634d0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:15.586219 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c793def-d66b-4884-9a82-68ff0d8471f3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.586538 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c793def-d66b-4884-9a82-68ff0d8471f3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.586818 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c793def-d66b-4884-9a82-68ff0d8471f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:15.607253 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9c793def-d66b-4884-9a82-68ff0d8471f3 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:15.608854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9c793def-d66b-4884-9a82-68ff0d8471f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:15.679254 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1291/2577] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:15.687523 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91a823-b1ec-42bf-a12d-99022659d679 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.687815 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91a823-b1ec-42bf-a12d-99022659d679 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.688098 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91a823-b1ec-42bf-a12d-99022659d679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:15.710255 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ca91a823-b1ec-42bf-a12d-99022659d679 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:15.711467 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ca91a823-b1ec-42bf-a12d-99022659d679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:15.719578 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1287/2578] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:15.724117 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c793def-d66b-4884-9a82-68ff0d8471f3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:15.733937 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c793def-d66b-4884-9a82-68ff0d8471f3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:15.738554 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8559c-257e-4426-ac27-3d2b47319b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:15.739145 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8559c-257e-4426-ac27-3d2b47319b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.739428 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8559c-257e-4426-ac27-3d2b47319b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.739703 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8559c-257e-4426-ac27-3d2b47319b34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:15.740348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8559c-257e-4426-ac27-3d2b47319b34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:44:15.740680 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8559c-257e-4426-ac27-3d2b47319b34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:15.742260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8559c-257e-4426-ac27-3d2b47319b34 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:15.754040 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1292/2579] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:44:15.758310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91a823-b1ec-42bf-a12d-99022659d679 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:15.768686 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91a823-b1ec-42bf-a12d-99022659d679 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:15.773447 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f3896-2055-4928-a996-ba5354d2b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:15.774037 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f3896-2055-4928-a996-ba5354d2b2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.774319 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f3896-2055-4928-a996-ba5354d2b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.774590 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f3896-2055-4928-a996-ba5354d2b2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:15.775221 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f3896-2055-4928-a996-ba5354d2b2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:15.777183 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f3896-2055-4928-a996-ba5354d2b2a2 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:15.782471 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:15.809748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1288/2580] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:44:15 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:15.810884 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8559c-257e-4426-ac27-3d2b47319b34 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:15.821228 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8559c-257e-4426-ac27-3d2b47319b34 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:15.880194 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054d6d6-5cf7-40e1-809a-75f86d73cada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:15.880822 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054d6d6-5cf7-40e1-809a-75f86d73cada admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.881107 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054d6d6-5cf7-40e1-809a-75f86d73cada admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.881383 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054d6d6-5cf7-40e1-809a-75f86d73cada admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:15.882012 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054d6d6-5cf7-40e1-809a-75f86d73cada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:15.883961 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054d6d6-5cf7-40e1-809a-75f86d73cada admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:15.908446 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1293/2581] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:44:15 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 03:44:15.909949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f3896-2055-4928-a996-ba5354d2b2a2 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:15.920104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f3896-2055-4928-a996-ba5354d2b2a2 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:15.925049 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9de432-64bd-4e9d-ad47-9d44c1caa927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:15.925648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9de432-64bd-4e9d-ad47-9d44c1caa927 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.925925 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9de432-64bd-4e9d-ad47-9d44c1caa927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.926194 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9de432-64bd-4e9d-ad47-9d44c1caa927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:15.926837 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9de432-64bd-4e9d-ad47-9d44c1caa927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:15.928486 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9de432-64bd-4e9d-ad47-9d44c1caa927 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:15.938295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1289/2582] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:15.942232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054d6d6-5cf7-40e1-809a-75f86d73cada admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:15.951837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054d6d6-5cf7-40e1-809a-75f86d73cada admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:15.957161 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ed955-c448-43d9-8728-61ee18088a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:15.957737 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed955-c448-43d9-8728-61ee18088a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.958015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed955-c448-43d9-8728-61ee18088a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.958285 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed955-c448-43d9-8728-61ee18088a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:15.958915 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ed955-c448-43d9-8728-61ee18088a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:15.960492 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ed955-c448-43d9-8728-61ee18088a95 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:15.971530 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1294/2583] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:15.975430 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9de432-64bd-4e9d-ad47-9d44c1caa927 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:15.985355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9de432-64bd-4e9d-ad47-9d44c1caa927 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:15.990129 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd39651-e673-4e53-9a59-a21c47c224f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:15.990765 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd39651-e673-4e53-9a59-a21c47c224f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:15.991048 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd39651-e673-4e53-9a59-a21c47c224f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:15.991323 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd39651-e673-4e53-9a59-a21c47c224f7 admin admin] PATH_INFO: `/v3/projects/8d1a5552c8f14ed687dee0cb5e5cd309/users/f85af092f7254264adda95b140efe13c/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:16.005594 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd39651-e673-4e53-9a59-a21c47c224f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1a5552c8f14ed687dee0cb5e5cd309, user_id=f85af092f7254264adda95b140efe13c, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:16.008222 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd39651-e673-4e53-9a59-a21c47c224f7 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:16.021631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1290/2584] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:15 2022] PUT /identity/v3/projects/8d1a5552c8f14ed687dee0cb5e5cd309/users/f85af092f7254264adda95b140efe13c/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:16.026610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750eb3c-e18d-4f1e-a54b-0621de601369 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:16.026904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750eb3c-e18d-4f1e-a54b-0621de601369 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:16.027233 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750eb3c-e18d-4f1e-a54b-0621de601369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:16.047750 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3750eb3c-e18d-4f1e-a54b-0621de601369 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:16.049555 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3750eb3c-e18d-4f1e-a54b-0621de601369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:16.109999 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1295/2585] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:16.119973 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd39651-e673-4e53-9a59-a21c47c224f7 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:16.121737 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-1dd39651-e673-4e53-9a59-a21c47c224f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:16.185950 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd39651-e673-4e53-9a59-a21c47c224f7 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:16.190191 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc7c47-411f-4c47-aaf1-f6e2aef83270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:16.190798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7c47-411f-4c47-aaf1-f6e2aef83270 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:16.191082 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7c47-411f-4c47-aaf1-f6e2aef83270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:16.191355 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc7c47-411f-4c47-aaf1-f6e2aef83270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:16.200310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc7c47-411f-4c47-aaf1-f6e2aef83270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:16.201758 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc7c47-411f-4c47-aaf1-f6e2aef83270 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:16.212610 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1291/2586] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:20.322753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750eb3c-e18d-4f1e-a54b-0621de601369 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:20.325590 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3750eb3c-e18d-4f1e-a54b-0621de601369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:20.333232 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:20.338987 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750eb3c-e18d-4f1e-a54b-0621de601369 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:20.346414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:20.347190 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:20.347540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:20.347880 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] PATH_INFO: `/v3/users/b6f43f110c024ceba3aa83227719bd9c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:20.349172 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f43f110c024ceba3aa83227719bd9c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:20.352878 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:20.432924 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f43f110c024ceba3aa83227719bd9c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:20.433708 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f43f110c024ceba3aa83227719bd9c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:20.444034 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f43f110c024ceba3aa83227719bd9c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:20.457267 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f43f110c024ceba3aa83227719bd9c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:20.458661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8adbf87a-1dac-402f-9d12-eb239f9969c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f43f110c024ceba3aa83227719bd9c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:20.486333 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1296/2587] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:20 2022] DELETE /identity/v3/users/b6f43f110c024ceba3aa83227719bd9c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:20.491109 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ba716-c7a1-40a7-8c52-5c8b17aac677 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:20.491603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ba716-c7a1-40a7-8c52-5c8b17aac677 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:20.491976 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ba716-c7a1-40a7-8c52-5c8b17aac677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:20.518717 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-ef4ba716-c7a1-40a7-8c52-5c8b17aac677 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:20.520715 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ef4ba716-c7a1-40a7-8c52-5c8b17aac677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:20.523500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b8beb-ec99-44cb-b072-49ca9df5172b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:20.523691 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b8beb-ec99-44cb-b072-49ca9df5172b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:20.523973 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b8beb-ec99-44cb-b072-49ca9df5172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:20.561929 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-383b8beb-ec99-44cb-b072-49ca9df5172b None None] MFA Rules not processed for user `f85af092f7254264adda95b140efe13c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:20.563247 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-383b8beb-ec99-44cb-b072-49ca9df5172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:20.595631 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1292/2588] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:44:20.614534 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ba716-c7a1-40a7-8c52-5c8b17aac677 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:20.616759 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-ef4ba716-c7a1-40a7-8c52-5c8b17aac677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:20.645912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1297/2589] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:44:20.653513 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b8beb-ec99-44cb-b072-49ca9df5172b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:20.655011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-383b8beb-ec99-44cb-b072-49ca9df5172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:20.671797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b8beb-ec99-44cb-b072-49ca9df5172b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:20.678806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8500c-c9a0-40a2-aad3-72eaf89ba3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:20.679514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8500c-c9a0-40a2-aad3-72eaf89ba3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:20.679862 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8500c-c9a0-40a2-aad3-72eaf89ba3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:20.680131 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8500c-c9a0-40a2-aad3-72eaf89ba3b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:20.680807 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8500c-c9a0-40a2-aad3-72eaf89ba3b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:20.682706 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8500c-c9a0-40a2-aad3-72eaf89ba3b4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:20.694383 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ba716-c7a1-40a7-8c52-5c8b17aac677 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:20.699832 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a5cd-c735-4922-b29b-08d13f7cadfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:20.700655 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a5cd-c735-4922-b29b-08d13f7cadfd service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:20.700936 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a5cd-c735-4922-b29b-08d13f7cadfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:20.701286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664a5cd-c735-4922-b29b-08d13f7cadfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:20.713185 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664a5cd-c735-4922-b29b-08d13f7cadfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:20.714739 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664a5cd-c735-4922-b29b-08d13f7cadfd service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:20.718801 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1298/2590] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:44:20 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:20.719444 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:20.724048 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8500c-c9a0-40a2-aad3-72eaf89ba3b4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:20.727770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1293/2591] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:44:20.787514 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:20.816718 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8500c-c9a0-40a2-aad3-72eaf89ba3b4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:20.822753 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8333bad-7e9e-485e-91c6-ec58a153551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:20.823620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333bad-7e9e-485e-91c6-ec58a153551e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:20.824170 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333bad-7e9e-485e-91c6-ec58a153551e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:20.824540 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333bad-7e9e-485e-91c6-ec58a153551e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:20.825403 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8333bad-7e9e-485e-91c6-ec58a153551e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:20.827505 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8333bad-7e9e-485e-91c6-ec58a153551e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:20.859393 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1299/2592] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:44:20 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:20.864398 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a5cd-c735-4922-b29b-08d13f7cadfd service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:20.874993 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664a5cd-c735-4922-b29b-08d13f7cadfd service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:20.881822 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb70fc-8f31-42c8-a3ca-cda749617deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:20.882709 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb70fc-8f31-42c8-a3ca-cda749617deb admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:20.883205 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb70fc-8f31-42c8-a3ca-cda749617deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:20.883742 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb70fc-8f31-42c8-a3ca-cda749617deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:20.884647 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb70fc-8f31-42c8-a3ca-cda749617deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:20.886504 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb70fc-8f31-42c8-a3ca-cda749617deb admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:20.909086 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1294/2593] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:20.911873 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8333bad-7e9e-485e-91c6-ec58a153551e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:20.926527 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8333bad-7e9e-485e-91c6-ec58a153551e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:20.932962 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64a4fc-f227-4700-9ea3-36d272476fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:20.933863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64a4fc-f227-4700-9ea3-36d272476fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:20.934144 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64a4fc-f227-4700-9ea3-36d272476fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:20.934778 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64a4fc-f227-4700-9ea3-36d272476fcc admin admin] PATH_INFO: `/v3/projects/5abba5c0d4cb40429e189933a4bc73f1/users/af65493a5e29439bb7fa02b2e36aee2b/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:20.954021 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64a4fc-f227-4700-9ea3-36d272476fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abba5c0d4cb40429e189933a4bc73f1, user_id=af65493a5e29439bb7fa02b2e36aee2b, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:20.957633 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64a4fc-f227-4700-9ea3-36d272476fcc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:20.974660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1300/2594] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:20 2022] PUT /identity/v3/projects/5abba5c0d4cb40429e189933a4bc73f1/users/af65493a5e29439bb7fa02b2e36aee2b/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:44:20.978621 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb70fc-8f31-42c8-a3ca-cda749617deb admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:20.991706 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb70fc-8f31-42c8-a3ca-cda749617deb admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:21.068000 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c246eb-7294-4b29-9d34-31ef71ba1298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:21.068697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c246eb-7294-4b29-9d34-31ef71ba1298 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.069127 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c246eb-7294-4b29-9d34-31ef71ba1298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.069238 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c246eb-7294-4b29-9d34-31ef71ba1298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.069879 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c246eb-7294-4b29-9d34-31ef71ba1298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:21.071499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c246eb-7294-4b29-9d34-31ef71ba1298 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:21.074235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64a4fc-f227-4700-9ea3-36d272476fcc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:21.075932 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4e64a4fc-f227-4700-9ea3-36d272476fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:21.088579 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1295/2595] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:21.089664 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c246eb-7294-4b29-9d34-31ef71ba1298 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:21.099337 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64a4fc-f227-4700-9ea3-36d272476fcc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:21.102071 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c246eb-7294-4b29-9d34-31ef71ba1298 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:21.106429 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:21.107043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.107329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.107890 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] PATH_INFO: `/v3/projects/ac94f8af2e0a414899e678b6c9c1988b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.107991 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d22679-d6c6-49db-838b-4e4b7d1e397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:21.108734 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d22679-d6c6-49db-838b-4e4b7d1e397e admin admin] REQUEST_METHOD: `PUT` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.109139 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac94f8af2e0a414899e678b6c9c1988b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:21.109264 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d22679-d6c6-49db-838b-4e4b7d1e397e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.109346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d22679-d6c6-49db-838b-4e4b7d1e397e admin admin] PATH_INFO: `/v3/projects/5abba5c0d4cb40429e189933a4bc73f1/users/af65493a5e29439bb7fa02b2e36aee2b/roles/9a4fa7f48c24440cae54bb4ec26b5b49` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.112332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d22679-d6c6-49db-838b-4e4b7d1e397e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abba5c0d4cb40429e189933a4bc73f1, user_id=af65493a5e29439bb7fa02b2e36aee2b, role_id=9a4fa7f48c24440cae54bb4ec26b5b49)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:21.113672 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:21.115400 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d22679-d6c6-49db-838b-4e4b7d1e397e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:21.128848 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1296/2596] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:21 2022] PUT /identity/v3/projects/5abba5c0d4cb40429e189933a4bc73f1/users/af65493a5e29439bb7fa02b2e36aee2b/roles/9a4fa7f48c24440cae54bb4ec26b5b49 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:21.167439 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac94f8af2e0a414899e678b6c9c1988b', 'request_id': 'req-35750a4c-2f95-4206-89f4-c9b3f412a14b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:21.173800 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac94f8af2e0a414899e678b6c9c1988b', 'request_id': 'req-35750a4c-2f95-4206-89f4-c9b3f412a14b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:21.181085 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac94f8af2e0a414899e678b6c9c1988b', 'request_id': 'req-35750a4c-2f95-4206-89f4-c9b3f412a14b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:21.194252 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] The token cache is being invalidate because project ac94f8af2e0a414899e678b6c9c1988b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:21.194545 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:21.195351 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35750a4c-2f95-4206-89f4-c9b3f412a14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:21.197827 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1301/2597] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:21 2022] DELETE /identity/v3/projects/ac94f8af2e0a414899e678b6c9c1988b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 03:44:21.203527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50146d53-489d-4f1a-84be-8cc0df813f5b None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.203819 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50146d53-489d-4f1a-84be-8cc0df813f5b None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.204116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50146d53-489d-4f1a-84be-8cc0df813f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.226330 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-50146d53-489d-4f1a-84be-8cc0df813f5b None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:21.227570 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-50146d53-489d-4f1a-84be-8cc0df813f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:21.294789 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1297/2598] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:21.303424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e741d-558c-4efd-b832-86f980e9b0bb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.303930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e741d-558c-4efd-b832-86f980e9b0bb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.304211 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e741d-558c-4efd-b832-86f980e9b0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.327623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d53e741d-558c-4efd-b832-86f980e9b0bb None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:21.328879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d53e741d-558c-4efd-b832-86f980e9b0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:21.338958 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1302/2599] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:44:21.343727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50146d53-489d-4f1a-84be-8cc0df813f5b None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:21.355429 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50146d53-489d-4f1a-84be-8cc0df813f5b None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:21.361706 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982f8dc-188d-49c7-98da-c6c524d06b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:21.362743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982f8dc-188d-49c7-98da-c6c524d06b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.362743 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982f8dc-188d-49c7-98da-c6c524d06b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.362930 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982f8dc-188d-49c7-98da-c6c524d06b27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.363546 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982f8dc-188d-49c7-98da-c6c524d06b27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 03:44:21.363816 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982f8dc-188d-49c7-98da-c6c524d06b27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:21.365695 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982f8dc-188d-49c7-98da-c6c524d06b27 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:21.381132 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1298/2600] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Nov 2 03:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 03:44:21.385681 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e741d-558c-4efd-b832-86f980e9b0bb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:21.400993 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e741d-558c-4efd-b832-86f980e9b0bb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:21.406312 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6be699-ddc7-44e9-bec6-ed0b07cfde3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:21.406918 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6be699-ddc7-44e9-bec6-ed0b07cfde3d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.407195 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6be699-ddc7-44e9-bec6-ed0b07cfde3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.407463 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6be699-ddc7-44e9-bec6-ed0b07cfde3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.408662 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6be699-ddc7-44e9-bec6-ed0b07cfde3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:21.411193 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6be699-ddc7-44e9-bec6-ed0b07cfde3d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:21.451508 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1303/2601] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Nov 2 03:44:21 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:21.454951 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982f8dc-188d-49c7-98da-c6c524d06b27 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:21.465522 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982f8dc-188d-49c7-98da-c6c524d06b27 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:21.562013 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:21.569941 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355165-e877-41f1-b7a1-e5f603e064fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:21.570778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355165-e877-41f1-b7a1-e5f603e064fc admin admin] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.571526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355165-e877-41f1-b7a1-e5f603e064fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.572028 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355165-e877-41f1-b7a1-e5f603e064fc admin admin] PATH_INFO: `/v3/users` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.572723 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6355165-e877-41f1-b7a1-e5f603e064fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:21.574647 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6355165-e877-41f1-b7a1-e5f603e064fc admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:21.598062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1299/2602] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Nov 2 03:44:21 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 03:44:21.601971 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6be699-ddc7-44e9-bec6-ed0b07cfde3d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:21.612828 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6be699-ddc7-44e9-bec6-ed0b07cfde3d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:21.618099 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3acb-7007-4988-a0a1-bb1e758e2646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:21.618740 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3acb-7007-4988-a0a1-bb1e758e2646 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.619025 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3acb-7007-4988-a0a1-bb1e758e2646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.619293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3acb-7007-4988-a0a1-bb1e758e2646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.619957 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3acb-7007-4988-a0a1-bb1e758e2646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:21.621631 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3acb-7007-4988-a0a1-bb1e758e2646 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:21.640332 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355165-e877-41f1-b7a1-e5f603e064fc admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:21.641356 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1304/2603] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 03:44:21.651318 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355165-e877-41f1-b7a1-e5f603e064fc admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:21.656087 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c46bdb-3d90-47b5-a40a-4cdd724df127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:21.656724 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c46bdb-3d90-47b5-a40a-4cdd724df127 admin admin] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.657010 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c46bdb-3d90-47b5-a40a-4cdd724df127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.657291 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c46bdb-3d90-47b5-a40a-4cdd724df127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.657970 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c46bdb-3d90-47b5-a40a-4cdd724df127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:21.659571 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c46bdb-3d90-47b5-a40a-4cdd724df127 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:21.670239 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1300/2604] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Nov 2 03:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 03:44:21.674564 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3acb-7007-4988-a0a1-bb1e758e2646 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:21.684743 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3acb-7007-4988-a0a1-bb1e758e2646 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:21.690189 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49004f-a192-48df-855f-8721506db3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:21.690841 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49004f-a192-48df-855f-8721506db3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.691029 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49004f-a192-48df-855f-8721506db3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.691306 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49004f-a192-48df-855f-8721506db3ea admin admin] PATH_INFO: `/v3/projects/e1bfe58196fe497c9326d3d902d2f38c/users/e00e1c44814540caa0b8426699b94b15/roles/f36bf60d6adc430cb9cd4b01f399fa18` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.708041 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49004f-a192-48df-855f-8721506db3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bfe58196fe497c9326d3d902d2f38c, user_id=e00e1c44814540caa0b8426699b94b15, role_id=f36bf60d6adc430cb9cd4b01f399fa18)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:21.710771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49004f-a192-48df-855f-8721506db3ea admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:21.734797 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1305/2605] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Nov 2 03:44:21 2022] PUT /identity/v3/projects/e1bfe58196fe497c9326d3d902d2f38c/users/e00e1c44814540caa0b8426699b94b15/roles/f36bf60d6adc430cb9cd4b01f399fa18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:21.738421 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13eb56-c5a4-4951-9f75-79a765b83ab7 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.738714 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13eb56-c5a4-4951-9f75-79a765b83ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.738995 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13eb56-c5a4-4951-9f75-79a765b83ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.775306 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-6f13eb56-c5a4-4951-9f75-79a765b83ab7 None None] MFA Rules not processed for user `e00e1c44814540caa0b8426699b94b15`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:21.776634 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-6f13eb56-c5a4-4951-9f75-79a765b83ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:21.855493 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1301/2606] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:21.867319 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49004f-a192-48df-855f-8721506db3ea admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:21.869802 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9e49004f-a192-48df-855f-8721506db3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:21.908781 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:21.942588 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49004f-a192-48df-855f-8721506db3ea admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:21.946279 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00075a8c-f80d-4b14-94e5-7f8ef0a5f6f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:21.946966 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00075a8c-f80d-4b14-94e5-7f8ef0a5f6f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:21.947382 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00075a8c-f80d-4b14-94e5-7f8ef0a5f6f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:21.947833 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00075a8c-f80d-4b14-94e5-7f8ef0a5f6f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:21.958273 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00075a8c-f80d-4b14-94e5-7f8ef0a5f6f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:21.959803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00075a8c-f80d-4b14-94e5-7f8ef0a5f6f3 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:21.969582 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1306/2607] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:21.997064 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13eb56-c5a4-4951-9f75-79a765b83ab7 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:22.082994 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13eb56-c5a4-4951-9f75-79a765b83ab7 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:22.088055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:22.089024 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:22.089612 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:22.090050 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] PATH_INFO: `/v3/users/e00e1c44814540caa0b8426699b94b15` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:22.091887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00e1c44814540caa0b8426699b94b15)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:22.094055 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:22.150208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00e1c44814540caa0b8426699b94b15'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:22.150927 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00e1c44814540caa0b8426699b94b15'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:22.160830 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00e1c44814540caa0b8426699b94b15'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:22.161573 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00e1c44814540caa0b8426699b94b15'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:22.170456 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:22.176286 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00e1c44814540caa0b8426699b94b15'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:22.195349 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1302/2608] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:44:21 2022] DELETE /identity/v3/users/e00e1c44814540caa0b8426699b94b15 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:22.197256 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06f8f9-61f2-42ed-904c-55a359b65524 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:22.197547 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06f8f9-61f2-42ed-904c-55a359b65524 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:22.197821 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06f8f9-61f2-42ed-904c-55a359b65524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:22.218536 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4e06f8f9-61f2-42ed-904c-55a359b65524 None None] MFA Rules not processed for user `74e842bce75f4436a698ca681099c480`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:22.219942 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4e06f8f9-61f2-42ed-904c-55a359b65524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:22.286449 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1307/2609] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 03:44:22.296431 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:22.299196 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:22.365577 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140608dd-aedc-4d61-86bd-91c21c7b654e admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:22.369756 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e897340-d298-4483-b49a-b4da0680223d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:22.370370 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e897340-d298-4483-b49a-b4da0680223d service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:22.372779 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e897340-d298-4483-b49a-b4da0680223d service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:22.373295 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e897340-d298-4483-b49a-b4da0680223d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:22.394367 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e897340-d298-4483-b49a-b4da0680223d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:22.396887 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e897340-d298-4483-b49a-b4da0680223d service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:22.425301 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1303/2610] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:22.721432 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06f8f9-61f2-42ed-904c-55a359b65524 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:22.723267 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4e06f8f9-61f2-42ed-904c-55a359b65524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:22.737315 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06f8f9-61f2-42ed-904c-55a359b65524 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:22.742779 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:22.744261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:22.744261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:22.744261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] PATH_INFO: `/v3/projects/e1bfe58196fe497c9326d3d902d2f38c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:22.745770 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bfe58196fe497c9326d3d902d2f38c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:22.748047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:22.807749 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bfe58196fe497c9326d3d902d2f38c', 'request_id': 'req-0405e432-4612-46a7-a7f9-a71b32240152'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:22.817441 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bfe58196fe497c9326d3d902d2f38c', 'request_id': 'req-0405e432-4612-46a7-a7f9-a71b32240152'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:22.825314 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bfe58196fe497c9326d3d902d2f38c', 'request_id': 'req-0405e432-4612-46a7-a7f9-a71b32240152'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:22.844205 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] The token cache is being invalidate because project e1bfe58196fe497c9326d3d902d2f38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:44:22.844896 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:22.846803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:44:22.849153 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1308/2611] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:44:22 2022] DELETE /identity/v3/projects/e1bfe58196fe497c9326d3d902d2f38c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:44:25.937345 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49037791-6591-411d-a5db-0aee622685cc None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:25.937855 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49037791-6591-411d-a5db-0aee622685cc None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:25.938017 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49037791-6591-411d-a5db-0aee622685cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:25.969290 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-49037791-6591-411d-a5db-0aee622685cc None None] MFA Rules not processed for user `af65493a5e29439bb7fa02b2e36aee2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:25.970551 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-49037791-6591-411d-a5db-0aee622685cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:26.053405 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1304/2612] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:26.071651 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:26.074427 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:26.130687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:26.155271 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405e432-4612-46a7-a7f9-a71b32240152 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:26.161234 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e600-28b8-4521-abd8-7fa074fcad4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:26.161863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e600-28b8-4521-abd8-7fa074fcad4a service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:26.162146 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e600-28b8-4521-abd8-7fa074fcad4a service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:26.162419 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e600-28b8-4521-abd8-7fa074fcad4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:26.164204 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9d68e600-28b8-4521-abd8-7fa074fcad4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:26.227026 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68e600-28b8-4521-abd8-7fa074fcad4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:26.228645 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68e600-28b8-4521-abd8-7fa074fcad4a service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:26.238630 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1309/2613] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:27.280960 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe043a7-d414-4c25-abfa-7efab193f589 None None] REQUEST_METHOD: `POST` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:27.281845 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe043a7-d414-4c25-abfa-7efab193f589 None None] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:27.282192 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe043a7-d414-4c25-abfa-7efab193f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:27.303722 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.auth.core [None req-abe043a7-d414-4c25-abfa-7efab193f589 None None] MFA Rules not processed for user `f85af092f7254264adda95b140efe13c`. Rule list: `[]` (Enabled: `True`). {{(pid=81396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 03:44:27.305044 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-abe043a7-d414-4c25-abfa-7efab193f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:27.312171 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1305/2614] 10.222.0.20 () {58 vars in 958 bytes} [Wed Nov 2 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 03:44:36.235311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=32 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:37.297648 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=67,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:43.623281 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e600-28b8-4521-abd8-7fa074fcad4a service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:43.624794 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9d68e600-28b8-4521-abd8-7fa074fcad4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:43.680045 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e600-28b8-4521-abd8-7fa074fcad4a service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:43.683660 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c964-2af3-4835-8209-c07a9bec950e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de29056c157e47a49e55a75fb0792dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:43.684260 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c964-2af3-4835-8209-c07a9bec950e service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:43.684565 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c964-2af3-4835-8209-c07a9bec950e service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:43.684837 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c964-2af3-4835-8209-c07a9bec950e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:43.686549 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fc75c964-2af3-4835-8209-c07a9bec950e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:43.700367 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75c964-2af3-4835-8209-c07a9bec950e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:43.701803 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75c964-2af3-4835-8209-c07a9bec950e service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:43.712758 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1310/2615] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:45.449700 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe043a7-d414-4c25-abfa-7efab193f589 None None] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:45.451113 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-abe043a7-d414-4c25-abfa-7efab193f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:45.461969 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c964-2af3-4835-8209-c07a9bec950e service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:45.463425 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fc75c964-2af3-4835-8209-c07a9bec950e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:45.522097 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c964-2af3-4835-8209-c07a9bec950e service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:45.523068 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe043a7-d414-4c25-abfa-7efab193f589 None None] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:45.525996 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0856fb8-95e8-49a8-9463-a3434b7283a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:45.526683 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0856fb8-95e8-49a8-9463-a3434b7283a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:45.527032 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0856fb8-95e8-49a8-9463-a3434b7283a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:45.527313 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0856fb8-95e8-49a8-9463-a3434b7283a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:45.528070 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abfbda-e958-4953-b4e6-e55e889dfaad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:45.528710 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abfbda-e958-4953-b4e6-e55e889dfaad service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:45.528992 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abfbda-e958-4953-b4e6-e55e889dfaad service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:45.529106 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e0856fb8-95e8-49a8-9463-a3434b7283a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:45.529268 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abfbda-e958-4953-b4e6-e55e889dfaad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:45.530957 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-10abfbda-e958-4953-b4e6-e55e889dfaad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:45.543111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0856fb8-95e8-49a8-9463-a3434b7283a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:45.543272 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abfbda-e958-4953-b4e6-e55e889dfaad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:45.544569 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0856fb8-95e8-49a8-9463-a3434b7283a5 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:45.544748 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abfbda-e958-4953-b4e6-e55e889dfaad service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:45.554747 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1306/2616] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:45.560503 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1311/2617] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 03:44:47.445782 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abfbda-e958-4953-b4e6-e55e889dfaad service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:47.457130 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abfbda-e958-4953-b4e6-e55e889dfaad service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:47.461006 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043c1a6-37f2-4c54-8dda-387434672df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:47.461627 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c1a6-37f2-4c54-8dda-387434672df5 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:47.461905 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c1a6-37f2-4c54-8dda-387434672df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:47.462178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c1a6-37f2-4c54-8dda-387434672df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:47.463949 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c043c1a6-37f2-4c54-8dda-387434672df5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:44:47.475208 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043c1a6-37f2-4c54-8dda-387434672df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:47.476678 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043c1a6-37f2-4c54-8dda-387434672df5 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:47.485778 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1307/2618] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:44:55.551176 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=52 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:57.481491 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=38 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:44:57.923700 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0856fb8-95e8-49a8-9463-a3434b7283a5 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:44:57.932819 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0856fb8-95e8-49a8-9463-a3434b7283a5 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:44:57.936293 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d693479-baef-44b4-8a02-6430c60c6c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:44:57.936920 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d693479-baef-44b4-8a02-6430c60c6c11 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:44:57.937196 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d693479-baef-44b4-8a02-6430c60c6c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:44:57.937467 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d693479-baef-44b4-8a02-6430c60c6c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:44:57.947235 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d693479-baef-44b4-8a02-6430c60c6c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:44:57.948674 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d693479-baef-44b4-8a02-6430c60c6c11 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:44:57.958015 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1312/2619] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:44:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:45:07.953716 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:47:28.289632 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043c1a6-37f2-4c54-8dda-387434672df5 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:47:28.291034 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-c043c1a6-37f2-4c54-8dda-387434672df5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:47:28.306104 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043c1a6-37f2-4c54-8dda-387434672df5 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:47:28.311207 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec3d92-3fec-4ae1-a732-2d5f9015e69e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:47:28.311806 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec3d92-3fec-4ae1-a732-2d5f9015e69e service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:47:28.312089 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec3d92-3fec-4ae1-a732-2d5f9015e69e service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:47:28.312362 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec3d92-3fec-4ae1-a732-2d5f9015e69e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:47:28.314629 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-efec3d92-3fec-4ae1-a732-2d5f9015e69e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:47:28.325939 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec3d92-3fec-4ae1-a732-2d5f9015e69e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:47:28.327499 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec3d92-3fec-4ae1-a732-2d5f9015e69e service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:47:28.337971 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1308/2620] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:47:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:47:29.006605 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d693479-baef-44b4-8a02-6430c60c6c11 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:47:29.015851 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d693479-baef-44b4-8a02-6430c60c6c11 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:47:29.019912 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a6d0-c0de-4b18-82a7-059b0ea141ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:47:29.020599 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a6d0-c0de-4b18-82a7-059b0ea141ca service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:47:29.020881 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a6d0-c0de-4b18-82a7-059b0ea141ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:47:29.021155 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a6d0-c0de-4b18-82a7-059b0ea141ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:47:29.022895 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f827a6d0-c0de-4b18-82a7-059b0ea141ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:47:29.033537 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827a6d0-c0de-4b18-82a7-059b0ea141ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:47:29.034954 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827a6d0-c0de-4b18-82a7-059b0ea141ca service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:47:29.043261 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1313/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:47:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:47:30.178545 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec3d92-3fec-4ae1-a732-2d5f9015e69e service placement] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:47:30.188828 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec3d92-3fec-4ae1-a732-2d5f9015e69e service placement] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:47:30.192525 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de8617-11ea-478f-9f36-1ac121447039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:47:30.193131 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de8617-11ea-478f-9f36-1ac121447039 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:47:30.193418 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de8617-11ea-478f-9f36-1ac121447039 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:47:30.193699 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de8617-11ea-478f-9f36-1ac121447039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:47:30.195414 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f3de8617-11ea-478f-9f36-1ac121447039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:47:30.205697 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de8617-11ea-478f-9f36-1ac121447039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:47:30.207202 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de8617-11ea-478f-9f36-1ac121447039 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:47:30.215584 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1309/2622] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:47:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:47:30.312846 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a6d0-c0de-4b18-82a7-059b0ea141ca service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:47:30.322666 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a6d0-c0de-4b18-82a7-059b0ea141ca service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:47:30.326414 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3600c68-96a3-4623-a1f1-2bd651032986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:47:30.327329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3600c68-96a3-4623-a1f1-2bd651032986 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:47:30.327329 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3600c68-96a3-4623-a1f1-2bd651032986 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:47:30.327551 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3600c68-96a3-4623-a1f1-2bd651032986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:47:30.329930 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c3600c68-96a3-4623-a1f1-2bd651032986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:47:30.343687 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3600c68-96a3-4623-a1f1-2bd651032986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:47:30.345240 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3600c68-96a3-4623-a1f1-2bd651032986 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:47:30.356269 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1314/2623] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:47:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:47:32.124678 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de8617-11ea-478f-9f36-1ac121447039 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:47:32.127515 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-f3de8617-11ea-478f-9f36-1ac121447039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:47:32.148116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de8617-11ea-478f-9f36-1ac121447039 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:47:32.154169 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fcffb-de93-4368-99df-cd28bdd2a742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:47:32.154785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fcffb-de93-4368-99df-cd28bdd2a742 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:47:32.155077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fcffb-de93-4368-99df-cd28bdd2a742 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:47:32.155353 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fcffb-de93-4368-99df-cd28bdd2a742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:47:32.157961 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-816fcffb-de93-4368-99df-cd28bdd2a742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:47:32.174178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fcffb-de93-4368-99df-cd28bdd2a742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:47:32.176073 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fcffb-de93-4368-99df-cd28bdd2a742 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:47:32.190500 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1310/2624] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:47:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:47:40.351460 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=12 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:47:42.182883 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=18 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:07.089490 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3600c68-96a3-4623-a1f1-2bd651032986 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:49:07.105373 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3600c68-96a3-4623-a1f1-2bd651032986 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:49:07.112149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527389e-71c4-459b-ad53-b632d658c1a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:49:07.112806 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527389e-71c4-459b-ad53-b632d658c1a2 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:49:07.113092 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527389e-71c4-459b-ad53-b632d658c1a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:49:07.113500 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527389e-71c4-459b-ad53-b632d658c1a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:49:07.115377 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0527389e-71c4-459b-ad53-b632d658c1a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:49:07.129795 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527389e-71c4-459b-ad53-b632d658c1a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:49:07.131620 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527389e-71c4-459b-ad53-b632d658c1a2 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:49:07.144823 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1315/2625] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:49:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:49:09.356029 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fcffb-de93-4368-99df-cd28bdd2a742 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:49:09.368242 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fcffb-de93-4368-99df-cd28bdd2a742 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:49:09.373940 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947d318-b0f5-4395-a743-2011cf66de04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35afc6fb66a649e2a9d22ee01cccbc53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:49:09.374555 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947d318-b0f5-4395-a743-2011cf66de04 service nova] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:49:09.374860 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947d318-b0f5-4395-a743-2011cf66de04 service nova] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:49:09.375134 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947d318-b0f5-4395-a743-2011cf66de04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:49:09.377158 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0947d318-b0f5-4395-a743-2011cf66de04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:49:09.390542 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947d318-b0f5-4395-a743-2011cf66de04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:49:09.392114 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947d318-b0f5-4395-a743-2011cf66de04 service nova] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:49:09.404081 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1311/2626] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:49:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:49:13.863746 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527389e-71c4-459b-ad53-b632d658c1a2 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:49:13.880498 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527389e-71c4-459b-ad53-b632d658c1a2 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:49:13.886013 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bbdf3-e082-4b06-922d-5e702603d853 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:49:13.886623 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bbdf3-e082-4b06-922d-5e702603d853 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:49:13.886952 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bbdf3-e082-4b06-922d-5e702603d853 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:49:13.887229 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bbdf3-e082-4b06-922d-5e702603d853 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:49:13.889436 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ca0bbdf3-e082-4b06-922d-5e702603d853 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:49:13.902172 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bbdf3-e082-4b06-922d-5e702603d853 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:49:13.903959 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bbdf3-e082-4b06-922d-5e702603d853 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:49:13.926159 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1316/2627] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:49:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:49:16.293033 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947d318-b0f5-4395-a743-2011cf66de04 service nova] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:49:16.302527 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947d318-b0f5-4395-a743-2011cf66de04 service nova] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:49:16.306297 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926c688-389c-44be-bb9e-7928081c2d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aea5fababc0a497686549ed7b9b85c78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:49:16.306900 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926c688-389c-44be-bb9e-7928081c2d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:49:16.307178 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926c688-389c-44be-bb9e-7928081c2d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:49:16.307451 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926c688-389c-44be-bb9e-7928081c2d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:49:16.309665 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0926c688-389c-44be-bb9e-7928081c2d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:49:16.375027 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926c688-389c-44be-bb9e-7928081c2d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:49:16.376526 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926c688-389c-44be-bb9e-7928081c2d53 service neutron] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:49:16.387281 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1312/2628] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:49:17.142011 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bbdf3-e082-4b06-922d-5e702603d853 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:49:17.155610 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bbdf3-e082-4b06-922d-5e702603d853 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:49:17.160760 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18b6d3-267f-4459-8305-9eb2ed6300b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:49:17.161368 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18b6d3-267f-4459-8305-9eb2ed6300b8 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:49:17.161652 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18b6d3-267f-4459-8305-9eb2ed6300b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:49:17.161928 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18b6d3-267f-4459-8305-9eb2ed6300b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:49:17.163661 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ab18b6d3-267f-4459-8305-9eb2ed6300b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:49:17.177534 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18b6d3-267f-4459-8305-9eb2ed6300b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:49:17.179199 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18b6d3-267f-4459-8305-9eb2ed6300b8 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:49:17.190174 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1317/2629] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:49:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:49:17.206899 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926c688-389c-44be-bb9e-7928081c2d53 service neutron] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:49:17.208418 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-0926c688-389c-44be-bb9e-7928081c2d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:49:17.221463 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926c688-389c-44be-bb9e-7928081c2d53 service neutron] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:49:17.231952 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:49:17.233346 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:49:17.233637 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:49:17.233921 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] PATH_INFO: `/v3/users/f85af092f7254264adda95b140efe13c` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:49:17.235289 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85af092f7254264adda95b140efe13c)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:49:17.237282 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:49:17.284858 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85af092f7254264adda95b140efe13c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.285508 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85af092f7254264adda95b140efe13c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.292310 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85af092f7254264adda95b140efe13c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.293041 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85af092f7254264adda95b140efe13c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.305934 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85af092f7254264adda95b140efe13c'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.319184 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1313/2630] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:49:17 2022] DELETE /identity/v3/users/f85af092f7254264adda95b140efe13c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:49:17.493727 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18b6d3-267f-4459-8305-9eb2ed6300b8 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:49:17.504266 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18b6d3-267f-4459-8305-9eb2ed6300b8 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:49:17.561320 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:49:17.561904 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:49:17.562186 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:49:17.562462 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] PATH_INFO: `/v3/projects/8d1a5552c8f14ed687dee0cb5e5cd309` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:49:17.563572 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1a5552c8f14ed687dee0cb5e5cd309)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:49:17.565488 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:49:17.611684 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1a5552c8f14ed687dee0cb5e5cd309', 'request_id': 'req-95c4a643-5675-4ab4-97c8-93aa91fe7238'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.617207 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1a5552c8f14ed687dee0cb5e5cd309', 'request_id': 'req-95c4a643-5675-4ab4-97c8-93aa91fe7238'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.623771 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1a5552c8f14ed687dee0cb5e5cd309', 'request_id': 'req-95c4a643-5675-4ab4-97c8-93aa91fe7238'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.636111 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] The token cache is being invalidate because project 8d1a5552c8f14ed687dee0cb5e5cd309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:49:17.636402 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.637047 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.639080 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1318/2631] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:49:17 2022] DELETE /identity/v3/projects/8d1a5552c8f14ed687dee0cb5e5cd309 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:49:17.643152 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:49:17.644580 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:49:17.658603 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee3d5c-e1d3-4519-ab84-bc8cbabb859f admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:49:17.707727 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:17.718861 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:49:17.719498 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:49:17.719785 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:49:17.720058 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] PATH_INFO: `/v3/users/af65493a5e29439bb7fa02b2e36aee2b` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:49:17.721226 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af65493a5e29439bb7fa02b2e36aee2b)` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:49:17.723161 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:49:17.769062 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af65493a5e29439bb7fa02b2e36aee2b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.769694 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af65493a5e29439bb7fa02b2e36aee2b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.776485 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af65493a5e29439bb7fa02b2e36aee2b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.777110 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af65493a5e29439bb7fa02b2e36aee2b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.788798 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.notifications [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af65493a5e29439bb7fa02b2e36aee2b'} {{(pid=81396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:17.802103 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1314/2632] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Nov 2 03:49:17 2022] DELETE /identity/v3/users/af65493a5e29439bb7fa02b2e36aee2b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:49:17.972404 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:49:17.973879 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:49:17.987507 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4a643-5675-4ab4-97c8-93aa91fe7238 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:49:18.036406 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:18.049129 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e842bce75f4436a698ca681099c480', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6472819eb36466497e7080c4f423ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:49:18.049766 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:49:18.050043 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:49:18.050311 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] PATH_INFO: `/v3/projects/5abba5c0d4cb40429e189933a4bc73f1` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:49:18.051424 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5abba5c0d4cb40429e189933a4bc73f1)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:49:18.053349 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:49:18.098897 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abba5c0d4cb40429e189933a4bc73f1', 'request_id': 'req-cbf0db13-8ac6-4882-b704-d131e3f57844'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:18.104227 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abba5c0d4cb40429e189933a4bc73f1', 'request_id': 'req-cbf0db13-8ac6-4882-b704-d131e3f57844'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:18.110893 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abba5c0d4cb40429e189933a4bc73f1', 'request_id': 'req-cbf0db13-8ac6-4882-b704-d131e3f57844'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:18.123863 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] The token cache is being invalidate because project 5abba5c0d4cb40429e189933a4bc73f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 03:49:18.124149 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:18.124854 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cbf0db13-8ac6-4882-b704-d131e3f57844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 03:49:18.126321 dv-cinder-860209-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1319/2633] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Nov 2 03:49:17 2022] DELETE /identity/v3/projects/5abba5c0d4cb40429e189933a4bc73f1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 03:49:27.798564 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:49:28.120348 dv-cinder-860209-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 03:53:09.142521 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] Authenticating user token {{(pid=81396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 03:53:09.143947 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:53:09.280116 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd17b0-17da-4c0c-8062-17d9d91fea65 admin admin] Validating token access rules against request {{(pid=81396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 03:53:09.337824 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e52f7-280f-4afa-9ec5-b260e77b508a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b2777a51af45f5a86627d840f5b814', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd58acd3f17934bdfb90e72c13bc0ef9d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 03:53:09.338368 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e52f7-280f-4afa-9ec5-b260e77b508a service placement] REQUEST_METHOD: `GET` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 03:53:09.338770 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e52f7-280f-4afa-9ec5-b260e77b508a service placement] SCRIPT_NAME: `/identity` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 03:53:09.339053 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e52f7-280f-4afa-9ec5-b260e77b508a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 03:53:09.340792 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.fernet_utils [None req-923e52f7-280f-4afa-9ec5-b260e77b508a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 03:53:09.351874 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e52f7-280f-4afa-9ec5-b260e77b508a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 03:53:09.354077 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e52f7-280f-4afa-9ec5-b260e77b508a service placement] RBAC: Authorization granted {{(pid=81396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 03:53:09.363938 dv-cinder-860209-6-smb devstack@keystone.service[81396]: [pid: 81396|app: 0|req: 1315/2634] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Nov 2 03:53:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 03:53:19.359691 dv-cinder-860209-6-smb devstack@keystone.service[81396]: DEBUG dbcounter [-] [81396] Writing DB stats keystone:SELECT=89 {{(pid=81396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}